does it happen that fast!?

y
I just stopped taking my birth control pills Saturday . It is now Tuesday and I'm getting the pre period brown stuff. I stopped my pill on the regular pill not sugar for the period. 
Is it normal to get your period that fast after stopping !? Or is it just the brown stuff and no period ?? I'm in the middle of changing doctors so I don't have one right now.