I'm so scared!

I had my first transvaginal ultrasound today. The doctor clearly sees that I am pregnant but did not see a gestational sac or fetal pole. He thinks that I am only 4-5 weeks pregnant and that is why he couldn't see any thing. Has this happened to anyone? Is it still too early to see anything? I want this baby so badly. I can't help but be so very disappointed.