Sex pregnancy

Okay so me and my bf have been having sex and I take the birth control pill. I’m nervous because I don’t want babies and we don’t use a condom but he also pulls out. Should I be worried or will I be okay?