Paranoid boyfriend

I don't know if anyone has ever been in this situation before. But my boyfriend of 4 years still refuses to have sex with me because he's scared of getting me pregnant. We've done it about six times in out whole realtionship. Is this super werid? Should I be worried.