Could I be pregnant

So last Friday my boyfriend and I had sex. I’m on birth control and I never miss a dose more than a minute. We also use condoms. The condoms never broke, but when he pulled the condom off later he got some semen on his hands but wiped it off with a tissue. Like within the next minute he touched me around my vagina. Could there have still been live sperm on his hands? I also have been taking ovulation tests because I’m sometimes get worried that the pill doesn’t work. As far as I could tell from Thursday on last week I was getting negative results but I don’t know, I still worried, I did something dumb and took a plan b. Could I be pregnant??