Going off my birth control

My birth control I have found out makes me a terrible person to be around lately. I am having sex but mt boyfriend has low sperm count because of a bomb blowing up next to him in Afghanistan. And he pulls out and everything. Sometimes we use condoms sometimes we dont. But the likelihood of me getting pregnant is slim right? If it happened it's not the end of the world.