Not Telling Husband I'm TTC

I know this is a team effort and i have talked to him about my want for children, he said he doesn't really want one right now. We had TTC before when he did want to have a baby but too many months of me crying because AF showed (even after being late for 3 weeks at one time) got to us. I'm in my ovulation window and I told him. I even joked and said no sex during this time. We still end up having sex all throughout this window of time and he has finished in me. He still says he doesn't want a baby right now, so I'm feeling kind of bad because i know in my heart I want to and I made sure he would finish in me. I feel bad, what if in 2 weeks we find out we are having are baby, will he not want this?

Just ranting you guys, open to advice.