Took birth control pills upside down!

Jenna • Member of the North Carolina master chore, law clerk, Lover of life Luke and pasta!
I made the stupid mistake of taking my pills starting with the fourth week rather than the first week after my period!  It was really dumb of me but I am now wondering what to do?  I've been taking the pills as usual and only just realized this morning what I had done. Help!  do I keep taking my pills as usual even on the week my period is supposed to be coming?
Since I was taking the sugar pills without knowing it my husband and I were having unprotected sex. It's been two weeks so I'm assuming it's too soon to tell if I'm pregnant.