DH has varicocele, should we wait

We found out my husband has a varicocele about a year ago. We weren't married at the time. We were told that it could affect fertility but we weren't ready to have kids so the doctor didn't have us f/u with a urologist since it was asymptomatic. We've been married for two months and we have been TTC since our wedding night but no luck. I'm not sure if we should wait or talk with our PCP about it and get a semen analysis... thoughts? I do realize that we have only been TTC for two months but we're both 29yo and I'm about to be 30 and if we're going to have fertility issues, I would rather start the interventions sooner than later.