Not on the same page

What do you do when you and your husband are not on the same page? We have a four year old (took 18 months to conceive and then had a medical issue where we almost lost him at birth). We are 34 and 40 and I thought we were ready to try for number two. Have just entered month 3 after AF starting 8 days late. The highs and expectations of last month all came crashing down this morning when my husband made it clear he isn’t really sure about number 2.... what if I’m sick again... what is something happens... are we too old.

Now I feel like if I do fall pregnant it will be a resented pregnancy with ‘I told you so’ comments at every issue. I really don’t know that I can deal with the emotional roller coaster again every month and be fighting with my husband.