I really need your imput

I just started 3rd cycle TTC. 1 week before my AF in first cycle my progesterone was 0.51 and my husband was diagnosed with theratozoospermia but has a high amount of sperm... so for my second cycle my Gynecologist told me to take 5 clomid 50mg from CD 2 and went to see him on CD12. He inyected me HGC. We had sex for the next 3 days. He told me to call him if O got my period. So I did... now he says is better for us to start IUI but I just feel is too soon for that. I’m 34 and I has type II herpes so we only have unprotected sex near Ovulation. What do you think?? Should I try IUI or just wait to see what happens over the next few months?