When is too soon to celebrate?

Liz
I just found out I'm 4 weeks pregnant, I know my husband is very happy and  is still in shock. But it's stressing me out cause it seems like he doesn't want to really be happy yet or celebrate until after 12 weeks. How am I supposed to feel? When is too soon to be excited?