Torn between wanting kids and not wanting them

Does anyone else bounce between wanting to wait and wanting to get pregnant right away? My husband and I have talked about having a baby so many times. His dad died back in June and after that he said he wanted to start a family right away. A few months later, though, and he's starting to have doubts about having kids at all. We are currently just using the pull-out method. I had an IUD for several years and had it removed (due to it expiring.) I was put on BC pills but they made me sick so I stopped. My husband is aware of this. I would honestly love to get pregnant right now. I'm 27, have a well-paying job and benefits and so does my husband. We have a good-sized house. All the cards are lined up! But I don't want him to be upset if it does happen.