If I have way to much sex to conceive will it cause low sperm count

Ever since my hubby and I have been trying we would have sex a lot I mean a lot. Sometimes it would be everyday or every other day or every 2 days and sometimes 2 or 3 times in one day. I try to just do it once a day but we both have high sex drives so it's hard to control it lol. But sometimes when I'm not around he will jack off but it wouldn't be every day. If you had that much sex and you got pregnant just like that your lucky but for me not really its been almost 15 months. So should I just slow down on the sex a little bit?