How to know if I have oral herpes?

I hope you guys can help me out. I’ve been hooking up with this guy. Then he got this swelling, puffy, hurting thing on his lip. He called his nurse and they said it’s nothing, but then he said he got a doctor appointment to check anyway. He said I’m the only gal he has been kissing. Honestly it sounds like he thinks that I’m sick and that he got it from me. He did fingered me and then tasted his finger

But my lips are fine, there isn’t any symptoms for me at all 😞 It’s making me so insecure and sad. Could this really because of me? Has this ever happened to you guys? Please help