Emotionally attached

Husband thinks I'm getting to emotionally attached to early. I'm just over 4 weeks. He just doesn't want anything to happen, especially since we haven't been to the doctor yet. But of course I'm attached, it's our baby! I understand where he's coming from, but it's almost like he's expecting something to happen, which he's assured me he's not. Ugh...I can not wait to get to the doctor and out of the first trimester!