Using pulling out?

My husband and I have one son together who is 3. Before him, we used the pull out method for 8 years until we decided to try for himZ now I badly want another baby and he does not. I feel terrible for wanting this while he doesn't. But we are using the pull out method, which for us has been reliable.... But I'm still hoping to get pregnant. I can't take other birth control for medical reasons and he refuses to wear a condom. Am I terrible for feeling this way? It's not like I'm tricking him into pregnancy. We talked already, and if we do get pregnant, it will be ok. We know it's always a possibility but doubt we will. :(