TTC and antidepressants

Me and my husband are TTC but he takes antidepressants, Zoloft. He still has a sex drive and is able to reach orgasm it just takes a lot longer than it used to. He’s been on Zoloft for about 8 or 9 months. I’ve heard of these lowering your sperm count, making it harder to conceive. I’ve been off BC now since January, with no luck. This will be baby #2 for us and the first child it took a year to conceive and this was without him on Zoloft. Since it took so long the first time I assumed it could be the same this time. I was just wondering if anyone has been in a similar situation and what your outcome was?