I don't know what to do 😭

So my boyfriend and I had an accident last time we had sex, the condom slipped but he didn't finish. I took the emergency pill while using the patch (because it was the first day of me using it). Today I'm one day late, I took a pregnancy test and it came out negative. My doctor called me saying that it's really unlikely for me to be pregnant and that I should wait until I finish all my patches (tomorrow). I have been acting really worried and stressed and my boyfriend is the same, he apologized today, and it hurt, he sound like he was feeling guilty and I don't know if he regrets all this. Should I probably tell. Him to stop having sex if he feels this way?