Feeling uncomfortable

I've gained a lot of weight and my bf has said some hurtful things like fat ass gross and said he didn't want to have sex with me cuz I'm fat. I personally never felt so insecure or unloved like I have been feeling. We do not go out in public together and we hardly do anything as a couple. I feel so uncomfortable going out in public with him.  am I in the wrong for not wanting too?  (Due May 10)