Feeling frustrated

Summer
Me and my hub trying to have a second child. We talk about and agree. So when my fertility window is open each month he will say that he is tired from work. Work stress can't have sex. I'm rushing to work ( in the morning) . Or just go and sleep.
I feel so heart broken... I feel like I'm the cause of all this.