I need advice!!

So over a year ago my ex left me. Legit just up and left. Well my boyfriend now his ex kinda did the same thing. Well the difference is I don’t speak to my ex and he does. He knows it bothers me and he doesn’t care. I told him it was her or me. He DIDN’T CHOOSE. am I wrong for leaving? We’ve been together since January,and we’ve been TTC since June. Hos parents LOVE my girls. And I love his parents. We live in a camper that his parents technically own. And they told him his ex IS NOT welcome there. But he obviously doesn’t care. I’m over the fight. I’m over the insecurity. I’m over the whole damn thing. Am I wrong if I pack my stuff tell his parents thank you for everything and tell him we’re over because he can’t let his ex go?