When is the right time?

I had sex on the 10th 3 times, the first time we used a condom then the second and third time we used the withdrawal method... He is a new partner for me (I've only had one partner who used withdrawal for over 1.5 years and never had a problem). Then on the 15th we used withdrawal method and 16th had sex twice in less then an hour apart, used a condom but it broke and we didn't notice until he pulled out to switch positions. I'm just wondering when is the right time to take a pregnancy test? I know there's a high risk with the withdrawal method and the condom breaking (he never actually came in me) and I want to know as soon as possible. Should I take one now since we had unprotected sex on the 10th?