Just found out I have herpes

So I'm pretty stressed out rn and just found out I have herpes (and it came from an ex I dated for a couple years). According to the doctor I've had it for 6mo-1year and I've never even seen a rash, bump, on my mouth or vaginal area. I'm just kinda depressed rn and Even my doctor said he had no idea because I've seen him 3 times in the last 6 months (to address a latex allergy) and he never knew or saw anything irregular. We only found out because we did an annual Sti test and it came up. Wtf I'm just so pissed rn and honestly wanna punch somebody. I'm scared I won't have a normal life and I honestly feel so gross. Im always so careful and trusted him and this just really sucks. Ehhh