Husband is extremely not happy about my pregnancy

This is my third baby and I’m 32. I have history of recurrent miscarriages. I wanted to try for one more child. I knew I could get a few miscarriages before having a healthy pregnancy so I started as soon as my husband agreed to try for a baby. But now that I’m pregnant and tired, he is upset and doesn’t speak to me at all. He’s angry that we can’t go out and travel anymore. He is upset that I convinced him to make a third baby. Now all his plans have to change. I’m 4weeks4days and I don’t have strong pregnancy symptoms. I don’t have any nausea. I could miscarry. I can’t tell anyone about my pregnancy because it’s too early to announce. I feel very lonely. And my husband is ignoring me. I don’t think he’ll ever forgive me.