Anyone else's SO not happy about this pregnancy?

He was all about the "trying" part. Now that reality has hit, he is freaking out. It makes me feel awful, and very afraid that he will resent the baby. Won't talk to me because he says he doesn't want to say anything to upset me. I'm only 5 weeks, so anything can happen. But I want to be excited and feel like I'm alone in this. Anyone else?