If you thought the stress from work was causing infertility, would you quit?

I'm 90% sure this is the case for me right now, but I've never not worked. I'm afraid not working or working fewer hours would increase my depression, but this is important to us. Also, it would create some financial strain if I quit, but we would survive. My husband tells me to 'do whatever I want,' but I don't know what that is. Help? Advice?