No sex, When do you end it? Sorry if its lengthy!

To Start off, I love my boyfriend more than anything. I've always had a hard time expressing my feelings through words and I've always had walls built to keep everyone out, but I let him in and he's the best friend I've ever had. We've lived together for 2 years and in the past two years we've had various sex problems. In the beginning our sex life was GREAT! I lost my virginity to him 3 years ago and we've had some wild times. I fell in love with him and I loved being intimate. He would always be all over me and we would be fooling around a minimum 3x a day. I'm a person who relies on others' actions rather than words, so having sex was always my assurance and safety. It made me feel close to him. But then sometimes he couldn't get hard and I'd get upset. Happened multiple times and after fighting for a while about it he said all I ever wanted was sex from him. WTF?!? not true AT ALL! he was always the one initiating it and it hurt me a lot when I felt he wasn't as attracted to me. But all those times I would just get over it. It'd get better then back to the same old after a few months. He said it wasn't me and he'd go see a therapist time and time again but never did, and won't. I fell pregnant November of last year and we had sex in the beginning, but then all of a sudden we stopped. He knows it won't harm the baby etc, we got that all clear when we found out I was pregnant. But I guess in december/Jan sometime things changed. Wed have sex less and less. I didn't say anything cause nothing ever changed in the past, I just deal with it silently. Then wed only have sex in the middle of the night if he woke up hard. But I noticed that he'd be hard while groping me, then once he got inside of me he'd go soft. Not completely, he'd still cum, but he woul barely be hard. I let it go on a couple times a week and then I finally said something in February and we stopped having sex completely. He won't even talk about it if I mention it. Its like it doesn't matter at all to him. He still tries to do oral on me here and there and still wants me to jerk him off etc. But no sex. Its like I can't even talk about it I feel like. I feel so disconnected. I've gained a lot so far with this pregnancy and I hate myself a lot. Half the time I'd rather be dead. But I never fight with him or bring it up anymore. I know relationships aren't all about sex but I can't get over that its just completely gone from my life. We used to be so close in that way :( I feel myself drifting from him...I want to sleep alone often and feel uncomfortable when he tries kissing me etc. I know he only does it when he wants to cum. I feel neglected sexually. Were so young :( I just don't know what to do anymore. I always catch myself thinking that maybe things will be better after I give birth and lose weight, but I don't even want sex with him after. I've felt so unwanted this whole pregnancy that I'm just over it. He won't move out of my house and I feel so stuck.

I guess my question is what would you ladies do? Stay in a sexless relationship even though you aren't as happy as you up used to be? I know hell be a great dad and he's a WONDERFUL SO. Will do anything for me. Is sex a deal breaker?

-----

I don't think its ridiculous at all that I'm considering ending it over this. Its been the same problem over and over not just when I've been pregnant. And I can certainly blame him for me putting his feelings and sex together, because for a long time HE was all about sex. Right when he walked into my house he'd go straight for the bed. All times of the day. I was never with a guy before him, so I apologize for it making me feel wanted? We spend a LOT of time together but he completely switched his attitude towards sex and when it upset me, I wasn't aloud to bring it up cuz if I did then "all I want is sex". To me, being physical is a part of being in love and being together. I don't feel wrong for my feelings. I feel like I have a roommate not a boyfriend. Sex isn't the only way I feel his love, it was just special. And now its not. I've communicated this with him PLENTY of times. He doesn't understand my feelings about it. And him not caring makes me care even less.

----

Im like 99.9% sure he doesn't watch porn and he's not cheating. I've questioned if he's gay many times. I hate this situation.