Is 4 follicles too many????

I took femara this month CD 5-9. I already ovulate on my own but after 1 year TTC and 2 rounds of clomid still no BFP. I just left my ultrasound appt and dr appt and I have 4 good follicles 2 on each side and 1 really good one on each side. Now my doctor is nervous and told me to wait to have sex til she calls me and gives me the ok. Im on CD 14 and the images show im about to ovulate and I feel like i am about to also. I thought the whole point of fertility meds was to give you more follicles, better odds. Last month on clomid i had 3 good follicles and didn't get pregnant. She said she normally prescribes clomid and isnt as familiar with the femara and wants to make some calls to a fertility specialist and make sure its safe for us to have sex. Obviously i dont want quadruplets i would be ok with twins..I hope she calls me with some good news. I have been feeling really positive about this month.