Herpes question

In early 2017, my doctor said I tested positive for HSV1 which is known as oral herpes. They told me it was a very low strain and I should hardly get outbreaks. However, I’ve only ever had canker sores in my mouth(gotten them since I was a kid) and I’ve only ever gotten maybe one spot inside my vagina. Usually after rough sex. And it’s only happened a hand full of times. How can my test be positive for oral herpes but not genital? And my husband has never ever had an outbreak. We’ve been together close to 4 years. No idea who gave it to who or how long I’ve had it. The doctor told me I could’ve had it for over a year without knowing. Could I have gotten a false positive test? Especially since it only happens after rough sex??