Brown discharge every time after sex

So I’ve noticed for like the past year, most times after I have sex, a few days later I get brown discharge. Should I be worried about this because every time I freak out and am worried it’s implantation bleeding. Does anyone know what this is or get it too😅