I need some advice

I’m 7 months pregnant and my boyfriend which is the father of my baby had a previous marriage and had 2 daughters. Well we had a really rough relationship though out my pregnancy we broke up a couple of times and those times he went ahead and had sex with his ex . I took him back tried to just move on from it and I’ve been okay and haven’t been getting involved in their co parenting . She hates my guts so bad and has disrespected me and my son . So me and her don’t get along . Well now his older daughter which she’s 5 asked him to go trick or treating with them which is w his ex as well . I told him I do not agree and I feel uncomfortable and disrespected. I told him I wouldn’t mind if he just takes them or if I either go to . Am I wrong for this ? He told me I’m putting my feelings first but all I asked was for me to go along as well . I also asked if he could message his ex to let her know that she needs to respect our relationship bc I’m his girlfriend and she needs to be in good terms w me but he said he doesn’t want to bc she’s going to get mad and is going to affect the time with his daughters.

*UPDATE

So after he broke up with me on Thursday I cut all type of contact. I blocked him on everything including his phone number . He didn’t message me all weekend , I knew he didn’t because we out and partied and got drunk just as I thought. I also knew once the weekend was over he was going to reach out to me as well . Just to make things clear I never threatened to take my son away from him I actually told him that I would let him see him as many times as he like once he’s born . I’m not gonna put him on the birth certificate so he won’t have any rights over him . I know I won’t be getting any child support and even if I tried it won’t happen since he already has 2 daughters and doesn’t have a job . I’ve told him that I would reach out to him when I had the baby and that’s all . Well today he messaged and this is what he said .

I honestly don’t feel comfortable being around him during my pregnancy anymore he has caused me so much stress and drama since the beginning. I don’t need that when I give birth I wanna enjoy my pregnancy as much as I can . I still have love for him so it’ll be hard to around him that way .