New pregnancy wearing on my marriage

My husband and I suffered an early miscarriage in April. We just found out last week that we are expecting again. I'm a little over weeks and so far everything is good. But ever since we found out is like my marriage is suffering rather than becoming stronger. He doesn't like to talk about the baby and gets mad when I say stuff like "I just hope this baby sticks." He doesn't want me to talk like that but I have no one else to talk to about it. He's my husband I'm supposed to be able to tell him how I feel. And I don't feel comfortable having sex yet and it's like he's holding that over me head...I just feel so alone right now.