Ugh what to do

So my kid is in school he finally has a wonderful teacher who sits down and actually helps him, so my Babydad wants me to pull him out of school every other week for 2 weeks so he can see him every month yes he has visiting rights, we already have the long distance parenting time and he wants him to go to a school down there also I am just scared because I did everything right and he approved it and now he’s like oh our kid is on my lease he’s going to be on every lease he has family down here he is allowed to go to two different schools his teacher isn’t going to fucking keep my kid away from me I’m like huhhhhh