Would you force your child to go to his dad’s house if he didn’t want to?

I really don’t know what to do next. My ex bf/baby daddy’s wife is punishing my kids and I’m upset about it. I called him asking why she won’t let them play their X-Box. He said she had told them to pick up their room and that one of them told her no and that he didn’t have to listen to her because she’s not his Mom. So he’s not allowed on the Xbox and won’t be allowed on it until he apologizes. I don’t like this woman and she’s NOT my child’s mother. I am his mother so I don’t think he should have to apologize to her at all. I asked to speak to her and my ex won’t even allow me to talk to her so it’s not like our coparenting relationship has ever included her and I don’t think it should. If they’re going to punish my kids I think they should talk to me about it. My child shouldn’t come home upset and crying. He doesn’t want to go over there anymore and I’m inclined to keep both kids home from now on. We have a court order where he has 3 days of visitation every week, but my son his hurting emotionally and that’s just not good for a 5 year old to have to deal with.