first pregnancy struggles.

I'm really struggling with my first pregnancy. My husband and I have been married for 2.5 years and together for 7.5. Were almost 15 weeks along and my husband told me he's not interested in having sex any more, because it's "weird" and I look different. 
He's been having roller coaster of emotions, sleeping and uninterested one day and fully textured and painted the nursery by himself today. 
I feel fat, scared, lonely, and confused. Since this is my first, maybe it's just hormones, but I'm struggling that I'm doing this all wrong and my husband will remain detached and distant. Anyone else experiencing these feelings or change in relationships?