TTC and Marriage Rollercoaster

Is it just me or am I just a psychotic bitch??? I have been married for 15 years, and it's been an emotional rollercoaster since day 1 with this man. 
We've been TTC for a few years now but actively started taking meds within the last 6 months. 
My issue is that it seems like every single time I'm in my fertile week, my husband starts acting like a moody jerk! Then I start to second guessing whether I want to continue TTC... I don't tell him when I'm ovulating because I don't want to stress him out over all this so he doesn't realize his asshole-ness is perfectly ill-timed. Then it all blows over and everything is perfect again... 
I'm about done with this shit. I know everybody argues but my god, I need a mental break sometimes.