First round of IUI if this doesn’t work doctor said straight to IVF

So we had all our testing done my fertility doctor recommended we do a womb scrape did it that was March the 15th he said soon as cycle start I would start my Femara but I never got it last week he started me on Femara for 7 days we today for a sonogram only had one follicle should I be worried I only had one! Then it wasn’t where they wanted it so I go back Friday for another sonogram they say I shouldn’t be stressed but I can’t help it!!! I need advice