Do I have the right? Baby daddy drama (Long story)

Maddi
My SO has had a job offer to further his career but it's in London and we live just outside of Portsmouth(uk) For the past year and a half me and my SO have done EVERYTHING to keep my baby daddy happy he's even stopped us moving just a half hour away because he doesn't want to be away from his daughter, which we agreed not to go, baby daddy wants me to change my daughters school claiming the children there are too "rough" which I thought was disgusting and told him my daughter is staying in that school as it's great and she has all her friends there. Nothing rough about it, his family are extremely snobby. Every job offer my SO has had we've had to turn down and it's starting to get him down. If we move baby daddy won't have less time with his daughter it'll be just the same as it is now, he's telling me I don't have no right and he doesn't agree. Is he right don't I have a right and I'm being un reasonable or am I being reasonable with wanting the future of my SO and daughter to have a better life starting new. I mentioned the schools he wants our little one to go to are better in that area and now he's saying the one she's at is perfectly fine and would rather me and my SO split up then take his daughter "away from him" which I wouldn't be because nothing would change with his time with her. He also claims that I need to stop thinking about my SO and think about him. Which is clear I've always done I'm just sick of being stuck in one place.   
Sorry for the long story but I need to know if I am the one being unreasonable for wanting to work on mine and my SO future or keep the baby daddy happy and be stuck in a big loop for the next 15 years 
*update* I've mentioned to my ex I'm putting my relationship first as his time with his daughter is not going to change what so ever and also mentioned to him how I will be travelling to make it more fair for him to see her if travelling is what's causing him issues but I'm getting nothing back but me being selfish blah blah blah. And is now ignoring me thank you all you lovely ladies for your wonderful advice and I will be seeking legal advice, and hearing back from them tomorrow morning

Glow Resources

Let’s Glow

Glow is here for you on your path to pregnancy

Glow helps you navigate your fertility journey with smart tools, personalized insights, and guidance from medical experts who understand what matters most.

25+ million

Users

4.8 stars

200k+ app ratings

20+

Medical advisors