Sex while ovulating?

My boyfriend and I are both 17 and really want to have sex, but we're long distance (a year and a half now) and the only time we have to do it is while I'm ovulating. Apparently the chance of pregnancy is 9%, which is freaking me out. I'm not on birth control but we're going to be using a condom of course (Trojan ENZ- I heard they're pretty durable) and he's not going to cum inside of me. I really want to do this, but I'm a bit worried about the whole pregnancy thing. I'm not really open to taking plan B because I heard it can make you really sick and mess with your hormones. Should I just tell him that we can't, or will it be fine?