So confused

Just wondering if anyone could offer me any advice.
I have been ready to have a baby for the past few years now and have been very patient waiting for my husband to 'be ready' to ttc. I have had many problems with bc not 'agreeing' with my body so he sugested that I come off it last year. Since then we have been using the pull out method as a mutual decision. 
Well anyway, we went on holiday at the beginning of May, and before we left for the airport he surprised me with telling me that he wanted to ttc as soon as we got home from the holiday and was 100% on board with wanting a baby. I was so excited I nearly exploded! 
BUT two days after we got home, he said he had changed his mind! I was so devistated!
He then said, I don't want to use condoms, or the pull out method, we will just avoid ov days so I agreed. This was 2 months ago. He had not been careful at all apart from avoiding my suspected ov day, and says if we have an 'accident' then we will get through it.
I'm so confused! Does he want a baby? Is he to scared to say we're trying? 
We have a very good marriage and are very happy together, so waiting another few months to ttc would not bother me, I just wish I knew what was going on in his head!
Any advice would be appreciated :)