Herpes?

I always get ingrown hairs when I shave and that’s my go to method. My boyfriend gets cold sores when he’s stressed and he’s always eat me out before sex ( he gets super stressed after sex Bc we don’t want a baby but we use condoms and I have the implant). So after we’d get down and dirty the next day or two he’d start to get a sore on his lip. I know I didn’t have any stds or anything before we got together and he was a virgin. So I guess my question is should I be worried?

I don’t have any bumps or sores down there, there’s no itching or burning when I pee.