TTC reservations?

Anyone ever have reservations about TTC? Like finances, problems with kids/husband/family, work, stress or other situations? My oldest son gives me & my DH a run for our money & nothing I've done has helped him behaviorally. I think it's turned my DH's desire down, or off, to TTC. We don't prevent it but he doesn't talk about it like he used to. The thought makes me sad.