Advice? Or some insight please.

I found out my fiance takes care of himself up to 3xs a day and so now when I come home from work he doesn't want to do anything and there is nothing left. I feel like I'm unwanted and I have talked to him about it multiply times. It bothers me for a few reasons. like obv the baby part but also I feel like he wants those women and not me because I'm plus size. He has made me feel so insecure the last few months I'm trying not to be but this doesn't help me or my anxiety. Anyone else ever have this problem. I knew he did it once in awhile when I couldn't be there all day or days bc of work but now I'm getting ignored and he does it all the time and more than once a day. I feel guilty it bothers me but it does. Am I wrong?