Religious topic about birth control

My husband and I are religious. I was raised Baptist and he was raised Methodist. We had our 1st child in Feb and we are ready to start back having sex after a hard and rough delivery. I was on birth control when we got married, but came off of it as soon as I said, "I do!". I'm scared of the "Pill" it made me so emotional and crazy and I think the birth control stayed in my system for a long time since it took us nearly two years to have a baby and we had a miscarriage. I've heard horror stories of diaphragms and IUDs and we are not a fan of condoms. I called my doctor to talk about what type of birth control would be right for us. I told my husband about my appointment that I have made and that I was nervous. He told me that he didn't see why we should even use birth control..