Is withdrawal effective?

I did it with my boyfriend once without condom and I don't know if it was the right thing to do because we did it when the day said 22% chance. Should I be worried?