brown discharge and sex

I am 7 weeks pregnant tomorrow. I started having brown discharge two weeks ago then a week after had bleeding. I followed up with my OB & said everything was fine & at the hospital they said baby wasn't trying to come out. My question is, can I still have sex while discharging brown? My doctor said I could but the nervous wreck I am tells me otherwise. Thoughts?