What should I do?

Okay so long story short a close friend of mine stayed with me and my family for a month or so and during that time we got together and are secretly dating however while he was at my place he played with my little brothers and wasn't always the nicest (both sides were wrong) and he handled things a little immaturely and the way things are handled in his house and my mom is very upset by this and said he is never allowed to visit again but won't talk to him about it and told my little brothers that i had better not bring him home and if we get ever married she won't come to the wedding because he wasn't nice to them. And I think she thinks he's creating a wedge between me and my family and that I'm not putting my family first and that Is wrong. Honestly I'm very hurt by this because my mom has always been one of my best friends and my family always comes first but I also really love this guy and I'm so torn.... please help!

As for what my boyfriend, did, he jokingly told them once they were behaving like babies and I talked to him about it and he stopped immediately and also on a few occasions tried to get them to help out with household chores (dishes, laundry etc. ) by not playing games with them until chores were done. And also they were super obsessed with cap guns and water guns and he took them away when they wouldn't stop shooting at him and refused to play anymore games when they cheated at them. And I have since talked to him about this and he has apologized but my brothers don't feel it's adequate and keep telling my mom they hate him and understandably she takes their side always. And I'm not sure how to mend the relationship between them all😭