What do you say?

Rue
So me and my SO had sex 3 days before I ovulated...I told him this and said we really should use a condom as we are not really in the place to have a baby. Well to say the least he have up on the condom idea about half way through and we finished it out without one and he just pulled out (he always is pretty carful about it). Well in that small time I think a little swimmer made it because at 7depo I had some pretty nice pinky CM.... Plus a few other symptoms...although it's quite early to tell either way...anyways my best friend keeps telling me to talk to him, right, but I mean what do I say?! There isn't anything for sure, at this point it's just me kinda freaking out! Plus he has soccer and school(college) and he's taking extra hrs this year! Am I wrong in not wanting to burden him with the worry until we definitely have something to worry about? And if you think I should say something what would you say?