Am I the only one?

When I'm fertile, I never have sex with my boyfriend because I'm scared to get pregnant since you are most likely to get pregnant. We do proctect ourselves but I'm just wondering if I'm the only one? 
He is really respectful of my decisions but I also feel like I'm not giving him enough. He tells me it's okay. He can wait. But part of me feels like I'm not "pleasure" him enough. It is about a week of fertilization.