Plan B

So my boyfriend and I decided it was time to try something new. So we had sex without a condom but I took the plan b pill. I started bleeding from something that looked like a period but the blood was brownish. That was 5 weeks ago. Should I be worried?