Husband is on Paxil

So my husband has been on the medication Paxil for about three years now because he suffered from severe anxiety and panic attacks. The last three years he has had little to virtually no libido. Even when he does manage to get it up for a bit he struggles ejaculating. We both want to start a family so he started working with his doctor to slowly ween off the medication. I have read several articles that Paxil affects the quality of semen and even if you do conceive while on it there is a high risk of miscarriage. Luckily studies have shown that the quality of sperm does return to normal after the medication is stopped. I can't find any research that recommends a period of time to wait to TTC after the medication is stopped. Has anyone had any experience with this and can shed some insight? I would appreciate it. Me and my husband want to start a family so badly and we want to give our future child the best possible start in life.