can someone explain how I'm not?

I know this sounds silly but I am still scared. I don't plan on having sex for a while until I feel comfortable again. Because this is making me a nervous wreck. I'm on the pill and have been afraid of pregnancy. I've  had 3 withdrawal bleeds now since the scare and multiple negative pregnancy tests. My last day of my bleed was Sunday, but I have had some residual spotting the past two days like normal. We use condoms and none of them have broken. We check the condoms afterwards by filling the condoms up with water. None have leaked or anything. He also never ejaculates inside of me. He pulls out with the condom on. I take my pill everyday at the correct time. I have a line on my pelvic cavity that goes from almost my belly button down, but I read that you can have that from taking a pill with estrogen which I do.  Should I be worried? I'm not pregnant right?