Low sperm count or lack of sex?

Long story short. Been together 3 and half years. Only used protection for the first 3 months. We only have sex about once a week ( he has a low sex drive). He thinks he has a low sperm count, I think it's not having enough sex. I've tested positive on Lh tests and had an internal sonogram when I was 16 and was told I had cysts which weren't a "huge" deal. What's your opinion?