Frequency and Timing Help

My DH did an at home sperm test last month, which showed he has a low sperm count. We BD'd every day last cycle and that didn't work... so, this cycle we planned to BD every other day. Unfortunately, that didn't happen due to things out of our control and we got started later than we should've - and apparently, I O'd early. (I chart opk and bbt)

We BD'd on CDs 1, 6, and 12... opk was positive on CD12 (4 days earlier than normal)... If we are, in fact, dealing with a low sperm count issue, does it ruin our chances this month because we didn't BD on CD10 so there would be fresh sperm ready on CD12?