Ex and baby sitting

Not sure if this belongs here?

I have a 5 year old son from a previous relationship who I have 50% of the time. I am dating a new guy now and we have a little baby boy together and we also live together. (Been together a year and a half) My Ex knows this guy well as he worked with him and they have a lot of mutual friends so he knows he is a good guy.

Well I let my current bf watch my oldest son so I could go out for a few drinks with some friends. My ex found out and blew up at me. Telling me my bf CANNOT ever watch our son. It’s him, grandma or grandpa and that is it. Does he have any right telling me who can and cannot watch our son?

My bf and I had plans on New Year’s eve and our normal babysitter is out of town and I’m having my boyfriends mother watch both the kids and I’m not even telling my ex cause I feel he has no say over this. I could see if they were not responsible people but I would never put my children in that situation.

I should also mention he never has our son when he’s supposed to as he always has grandma take him. In November, he was with his dad 5 nights out of the 14 he should of had him.