Clomid, progesterone and low sperm count

Today was rough and I could really use some words of encouragement or success stories. My husband and I have been trying to conceive for 2 years and have had two miscarriages (very early on, like 6 weeks)

We finally went to the dr. a few weeks ago and was told my progesterone was low. I started taking Clomid 50 mg 5 days ago. Today we found out my husband has a low sperm count of 20 million. They referred us to a urologist but it will be a few weeks before we can see him.

Has anyone gone through this? What’s the next step? Any recommendations?!?