Sad...

So my fiance and I are living apart for now but we are moving in together in a few months. I am 6 weeks pregnant and lately it just feels like we are drifting apart. We used to see each other every single day and we used to text all day. Lately we have only been seeing each other a few times a week and we go all day not talking unless I finally text him. I tried expressing these feelings to him and all he said was "here we go" like he thought I was picking a fight. I want to cry because it's like I can never talk to him about what bothers me without him thinking i'm trying to fight. Idk what to do.