Using pulling out?

My husband and I have one son together who is 3. Before him, we used the pull out method for 8 years until we decided to try for himZ now I badly want another baby and he does not. I feel terrible for wanting this while he doesn't. But we are using the pull out method, which for us has been reliable.... But I'm still hoping to get pregnant. I can't take other birth control for medical reasons and he refuses to wear a condom. Am I terrible for feeling this way? It's not like I'm tricking him into pregnancy. We talked already, and if we do get pregnant, it will be ok. We know it's always a possibility but doubt we will. :( 
Do I talk to him again about it or just go on?

Glow Resources

Let’s Glow

Glow is here for you on your path to pregnancy

Glow helps you navigate your fertility journey with smart tools, personalized insights, and guidance from medical experts who understand what matters most.

25+ million

Users

4.8 stars

200k+ app ratings

20+

Medical advisors