Feeling the pressure :(

My husband & i have only been trying for 5 cycles now and i know this is still early but the other day my husband told me he only wants to try for a short amount of time because he is 33 and doesnt want a toddler at 40. So now i feel pressured to do something i have no control over. I feel like if we dont get pregnant soon all my dreams of having a baby will be taken away because i know i wouldn't want to force him to have a baby he didnt want. He looks at this as if it happens good but if it doesnt it wont bother him. I know this might be wrong for me to say but i feel like it doesnt matter as much to him because he has an 8yr son so he has already got to experience all the little moment only parents get to have