Am I over worrying?

I am on birth control pills and take them perfectly every day. So I'm going to name my weeks by 1, 2, and 3 (they are back to back weeks). But week 1 I had a orangish-brown discharge all week. Towards the end off the week, I missed my first pill ever, but took it the next day. Then a couple days later my discharge went back to clear/white. Then week 2 I had a light brown discharge. And now, week 3, I am on my sugar pills and have taken 2 and don't have my period. I am sexually active, but we use my birth control pills, a condom, and pull out. I am worried about being pregnant because of my weird discharge and period timing. Am I over worrying? No rude comments please. I just need opinions.