Help ASAP

So I was taking my birth control for a wholr month, when I got to the sugar pills I stopped taking them and then I totally forgot. So I decided to start taking them after my next period. So I did an I've been on them for about 7 days now, I missed a day.. So I doubled up. I take my pill at 4:00pm every day. This morning at around 7, my boyfriend and I had sex.. We used a condom.. It broke. He pulled out before he came, but he thinks that he was late to pull out. Should I take the morning after pill or should I be fine because I'm on Birth control??