Helppppp

So I have been on my birth control for awhile and I always take it on time or catch up when I miss. However, I lost my one active pill when I had 2 active pills left so I took the last one. I am now onto my inactive pills. Am I okay to take the inactive pill and continue on a day earlier? I last had sex about a day ago and was still on the birth control fine. He also pulled out. Just worried. Thanks for help