Husband always picks fights around ovulation

My husband and I have been trying to conceive for about 6 months now. I’ve noticed he tends to pick fights around that time or seems disinterested whenever I talk about ovulation time. He told me one month that it was a lot of pressure and to not talk about stuff in depth about it. The next month rolls around, I don’t bring it up and he gets angry with me for not telling him. So I try my best the month after to not bring it up too much and it was fine. The month after he asked me and got mad with me for not telling him. Fast forward to this month, I tell him and he seems disinterested altogether. I don’t know what to do and he seems to make things worse in our relationship around this time every month… what am I doing wrong?