Brown discharge

I am 5 weeks pregnant and been having brown discharge for the last three days, went to the doc last week but they said it was to early for an ultrasound and did blood test. Should ai be concerned?