Feeling discouraged

A little background, my husband and I have conceived 3 times, one of those resulting in a miscarriage. In 2016 he had testicular cancer and had one removed, we had 2 pregnancies after that.

2.5 years ago he started taking testosterone and we started trying to have a baby 6 months ago. We had his levels checked recently and realized his soerm count is low, he's been taking clomid for 3 months with not much change.

I had my yearly physical and asked my Dr about getting on clomid as well to increase our chances, he had my levels checked and I am also low.

Just wondering if anyone else has had a similar prognosis (both partners levels being low) and if there's still hope. We meet with a urologist next month but I am feeling overly anxious.