Low numbers/testosterone/varicocele

I'm going to warn you, this a slightly long post, but I appreciate any thoughts and feedback. In August my husband and I started really trying for a baby. We weren't having any luck and I went to the dr who referred me to an infertility specialist-not ultrasound and ovulation blood test were perfect- we did this early December. End of December my husband had a semen analysis done, and all of his numbers came back VERY low. I should mention my husband has a condition called congenital adrenal hyperplasia which directly correlates with some of your horomone levels. So, bc of his low semen analysis they upped his prednisone to try to combat this. We got referred to a urologist who we just saw on Feb. 22- on this day before the appointment he had his blood drawn to check testosterone, etc and also another semen analysis. His count went from 1.8 in December to 13.8 this month and his motility and everything is normal now too! Great news. Well, the doctor noticed he has a bit of a varicocele but didn't seem slightly concerned and wanted to wait to get blood tests back. His results showed he has pretty low testosterone (181-they like around 300 at least). So we were given 3 options: 1)surgery for the varicocele though he couldn't give us total certainty it would work 2) do IUIs or 3) start clomid (my husband) to help his testosterone and hopefully increase his count even more. We chose to start with clomid bc its least expensive and least invasive. So, I was wondering has anyone had experience with any of our options? What did you do how long did it take etc? In ten days he will have his testosterone check again, and another analysis in 3 months and we just keep trying in the mean time...but I would love any advice or success stories! Thank you so much ladies. 💗💗