TTC ruining my marriage

The stress of trying to conceive is ruining my marriage. 
Sex isn't fun anymore, everything is scheduled. It is hard to have sex with our schedules , it's like quick let's do this so that you can go to work. We both feel like we've failed when AF comes each month. 
He now wants to stop trying until my stress levels go down, which I agree the stress isn't good for me. But I don't know if stress will go down, I don't want to have no sex at all. 
I feel like I'll stress out until there is a baby in my arms. 
Anyone have any advice, tips and tricks to help us out? 
I want to figure it out, I want our relationship to be back to the way it is. I just don't want to wait because I think I'm going to stress out when we do start again, anyway. 
Thank you in advance for you advice!