Too much sex while ttc?

Okay I know this sounds a little crazy but I'm hoping you ladies will get it. We are ttc for #2 (hoping for a girl but don't care either way) we read about dtd before ovulation for best chances of a girl (I know I know, but it's worth a shot!) Well now that I'm finally in the ovulation time I'm worried that because we started dtd so early and have been doing it every single day that my husband's sperm hasn't had time to grow/reset/mature whatever it's called. BUT I'm scared to take a rest day and miss my window! As far as we know he doesn't have a low sperm count, he's young, active and healthy.. but I'm still paranoid now. Do we still have a pretty good chance if we continue to dtd every day until the end of ovulation?