DH Has Cold Feet About TTC

My husband and I have been married almost 2 years, together nearly 7. We have a beautiful marriage. ?. 
Back in April, when I was on birth control, I had a pregnancy scare. No period so I went to the doctor, it came back negative and we were both crushed. The whole week we went down the road of possibly being pregnant. We made a deal that starting 2015, I was going to stop talking BC. Well my best friend had a baby in October, and we got the baby fever even worse (if it were a real thing I would have been hospitalized). So we decided  I would stop a month early. 
Well now that I'm tracking my cycle, and the past few days being my fertile days with tomorrow being 33%, he's getting cold feet. I think telling him that number of "33%" is scary to him. I don't know how to reassure him and make him feel more comfortable. He borderline doesn't want to have sex but won't admit that it has anything to do with ovulating. This is all new territory for us. Any suggesting would be appreciated!