first ultrasound

My doctor had me do an ultersound when I was 2 days shy of 5 weeks just to make sure I wasn't any further along. 
Unfortunately we weren't able to see anything at that time? 
Should I be worried??