Spotting?

Baby has been moving around all day. I just got home from work and used the bathroom. When I wiped there was blood. Not bright red, but like a reddish brown. There was some mucus, but not a lot. I wipes a couple more times and it lessened, but the 1st time was all over the paper. I am still feeling baby moving and went to the bathroom again, and nothing. I haven't had any contractions or lost any mucus plug, I don't think. Should I be worried? A couple weeks ago my doctor said only if it was heavy like a period to be concerned, but it freaked me out.