Losing my virginity

So recently me and my boyfriend have been thinking about having sex, We really want to and we are both ready, however I am just so so worried about getting pregnant. We'd be using a condom and we agreed he will pull out too. Any advice? Should this be a reason to not do it?