Should I bite my tongue

So Iam 24 weeks pregnant with a boy and my fiance has a daughter that's 1 well the baby's mom will only let him see her and I'm not allowed around her or see her. So he sees her at his parents house. We're suppose to be moving in together this month but I told him this cannot continue he can't just leave me to be with his daughter that we need to be a family and the baby's mom has even gotten a lawyer and a paper stating that I can't be around her. She's a jealous military freak that can't see us happy or together and as much as he can try she'll always be able to break us apart. He's tried to talk to her but she said if I come close to her daughter she'll never him see her again. She spray can painted my car and hit me on the side of my head with it just because my fiancé picked me over her. So I told him I didn't want to be in a relationship like that and my ? Is should I move in with him or bite my tongue? I can't stay where I'm staying now it's too crowded and I'm only working once in a while so I won't be able to live on my own.. He says I'm making him pick between his daughter and I am I wrong