Am I being too much?

My ex husband left me 3 years ago. He realized he liked men and left me for a man. My world shattered. We have two sons together. All I ever wanted was a perfect family and to be loved. I've been talking to this guy since September and I really like him. My ex has created a rule about my boyfriends and our kids. My sons are 14 and 16 and my ex said until we've been together for at least a year not to introduce them to our kids because I was bringing way too many men around them and it made them uncomfortable. One of my ex boyfriends got mad at my 14 year old and hit him in the face with a belt and I called the police for it so I completely am understanding of why I have to wait now. So this guy also has kids. He has 3 and he does live a bit far. It's a 4 hour drive. There have been several occasions where I have canceled things I was doing with my kids to go and do something with him that he invited me too. Before anyone starts I still see my kids. We have basically a 60/40 custody split. My ex has them 60% of the time. I have them 40%. I still see them on a regular basis. I was just trying to build a relationship because like their dad is completely remarried to a man I have the right to move on.

So I asked this guy via FaceTime to spend my birthday with me next Saturday. He said he can't. His oldest has a play she's in. I understand that but I told him that there were several times I cancelled plans with my own kids to see him and I understand his kids are his first priority. I would just like to be a priority to. He got weird on FaceTime and asked why I didn't just tell him because he would have rescheduled. I told him I wanted to prove to him that he's a priority and I was just hoping for the same thing. He said he has to be at the play. He already promised and got off. Now he hasn't really been replying to me much. Was I being too much?! Did I fuck this up?