My Chinese Development is Slow

I have been in Taipei for over 5 years and my Chinese language skills are still not up to snuff. I am taking classes again, but words are just not sticking as quickly as I would like. Getting a better understanding, but concentrating on it is hard when work, child and other activities get in the way. Need to somehow get the Chinese involved in the other activities. Problem is the people around you don't want to deal with your slow American accented Chinese, so they revert to English and stop your growth. So that means I need to learn Chinese on my time. I my time is very limited. I will find time and become better. I need to. In the meantime I will continue to stumble.