Cold Sore with newborn

Hey all, my baby is a little over 2 weeks old and a few days ago I woke up with a cold sore. I’ve read so many horror stories about HSV1 so now I’m scared to even touch him. Has anyone else gotten a cold sore around their little one? How did you have peace of mind? I’ve washed my hands so much, they are starting to crack because they’re so dry 😭