freaking out

Last month I started taking birth control because my boy friend and I decided to start having sex. We had always used condoms as well, except a few days ago we didn't. I have been on birth control for like a month and a half now but I am not quite in the habit yet of taking it at the same time everyday, but I haven't missed a day. He pulled out and everything but I am of course still freaked out a little bit. If this helps I had still only gotten off my period 2 days prior to the unprotected sex. Has this happened to anyone else and if so, what became of it?