Bf thinks I don’t like his kid

We share a 6 month old infant and he has a 3 year old daughter from a previous relationship. I’ve been around since she was one and love her as my own, even tho obviously she isn’t.

Once the baby was born in the hospital he had the audacity to say I’m trying to replace his daughter and I don’t care about her because he was at the hospital with me while his daughter was stuck at his moms......

I pretty much am the parent who does everything for our baby and when I ask for help he brings up he has another daughter to care for...I don’t even ask for his help much just to take her for a couple hours one day out the week.

Also there are times where he gets mad at me if I play with her or she prefers me at times rather than him so at this point I just give them their space when she’s around

I’m also not allowed to discipline her which is insane to me because all I would say is no of stop and explain why. I don’t hit or yell.

Today his daughter came by and picked up my baby and was being rough. Idk about y’all but I’m not letting a 3 year old pick my baby up so I said “not so rough” as it makes sense to have he calm down because she can hurt her. He got mad and told me not to do that and let her do what she wants with her sister....

Can y’all tell me what the hell to do because I don’t like this t all and its making me not want to be with him. On top of all out problems.

I love his chil but he’s making me not wanna be around her because of him

I don’t even wanna be around him right now and I can’t trust that he’s gonna have my baby safe around his toddler