Should I be worried

So the other night I had unprotected sex but he pulled out. And the follwing morning I took the morning after pill. So it's been 2 days since and I have the brown discharge you get before you start your period but I just got off my period not to long ago. What should this mean.?