Husband annoying AF during TTC

Why does my husband not feel up to it during my fertile week but during other weeks it’s like he’s wanting to so bad? Frustrating for me when it’s my fertile days.. and I’m over here doing OPKs, limiting alcohol, watching what I eat etc etc. and when it’s time it’s time to BD.. don’t have time to make it romantic or big ordeal.. I know it’s not sexy to plan when we have to do it, but it’s critical time. Soooo annoying anyone in same boat?!