I need advice..

After venting to my husband about how I feel we’ll never have another child because I can’t conceive, he told me that he doesn’t want to try anymore because he’s rather us just move on with our lives instead of wasting our time trying. Which I understand, we have devoted our life to ttc and frankly I’m exhausted from tracking, temping, and everything else that comes with it so I had to agree. We agreed to love our 5 year old with everything we had and to just leave it be. He’s training to become a CFI so a lot of his time and our money will/is spent on flight time for the time being. Well, this was about two weeks ago and now I’m 5 days late, tests are showing a very clear negative though. I’m kind of nervous as we have already talked about stopping trying and have made other plans for our life.. He had already stopped training for our first child and now that he has started again, I’m afraid he’d feel like he had to stop again and I don’t want him too.. I know I’m all over the place with this, I just have so much on my mind.