He forces sex , what can I do ?

Every time my baby’s dad comes to visit he forces sex . Last time he grabbed my arms despite the fact that I told him no and tried to push him off severs times. After that I just went with it the next time because I didn’t want to feel like something was being taken . But tonight I consented but he just used me for sex and left . I know I’m stupid but now I’m really hurt . What can I do? I don’t want to have sex with him anymore but I don’t want him to force it either 😔. Since we have a baby who is 6 months when should I let him see him and where? I don’t want to feel this horrible again