herpes

so me and this guy hooked up (yes we wore a condom) but he performed oral on me and come to find out he’s had oral herpes. and he hasn’t had a break out in years but i’m so worried. is there any way he could spread it to me even though he wasn’t broken out? i don’t have any sores or blisters or anything but i am itchy down there.