Torn, to tell or to not to

My husband and I have been trying for 4 years and he will be 42 soon and I will be 36 next year. I have pretty much lost all interest in TTC anymore, largely due to I don't to still be raising a child even older one when I am in my 60's I just don't know if and how to break it to him. See i don't think he is fertile but he has been putting off check because of money.