Ear wax

My two years old has been sick a couple of times and been to the doctors and every time they check his ears I always get the same reaction. "Wow, there's a lot of wax in there. Unfortunately I can't see anything in his ears due to the wax". The doctors have never said anything about cleaning them or it being bad though. Am I doing anything wrong? I'm not putting anything in his ears, but after showers or baths I clean them with a towel, but obviously it doesn't get inside. He often has wax falling out of his ears and then I clean it up as well.