Question

So two pill packs ago I started the pill late ( like 4 days late) and I got my heavy normal period I normally get. Then I started the next pill pack on time and did not miss a pill and all I got for my period was brown spotting. I took a pregnancy test like 4 days into my sugar pills and the test was negative. Should I be worried I ovulated during the sugar pill week or was that my period?