Husband backing out?

So my husband and I decided 6 months ago to start trying for a baby! We were so excited and he told friends from work. Sadly I was on birth control and once I stopped we had to wait for all my hormones to get back in line so it’s took 5 months for me to get my period after quitting the pills! This is my fertile week and now he doesn’t want to talk about it. He keeps saying he is too tired for sex. (But yet he stayed up way later than normal to watch game 6 and 7 of the World Series?) I cant help but be so upset thinking he is backing out of wanting a baby!