Brown discharge

I'm 24 weeks pregnant. And on Friday afternoon and then today (Sunday) I have gone to the bathroom and when I wiped had a very slight brownish discharge. I plan on calling my doctor tomorrow to check in- should I be calling my emergency number today? How worried should I be?