Late but not pregnant?

Brittany

I’m 5 days late and I’m on the pill. Went off it for a day and had sex with my husband with no protection. We were told there’s a strong chance we can’t have kids due to lack of sperm in his stuff but now I’m not so sure. Has anyone else ever been late while taking her pill after missing for only 1 day?