sex question

so I'm relatively new to sex and I've only done it twice. once was on my first fertile day and once the day after. both times we used condoms and both times he pulled out. I shouldn't have to worry about accidental pregnancy right? 😅