What would y’all do

I lived in my bd’s hometown for a year and it was the worst. Hardly had any support from his mom, got into it with his friends a lot because they always tried to get him to cheat, and a lot more. My bd went over seas and I moved back home because I couldn’t take it anymore.

My son and I are doing fine here and when my bd came back he didn’t have too many issues but he wants to move back to his city. I considered it for some reasons he had put into my head. He went back over seas again and I drove to his city to visit his family and EVERYTHING went to shit. His mom was disrespectful, got into it with his friends, etc. I told him I refuse to move back, he said “no you said it was an option u can’t change your mind”. I told him he can go back I’m gonna stay here.

Am I making the right decision? Feel like I’m breaking up the family.

(I’ll add another post later as to what happened between his friends and I it’s too long for this post )

Forgot to add yes we are together