Cold sore question

My husband apparently had a cold sore that went away a couple days ago. I just saw another post on here that her boyfriend had a cold sore and went down on her and now it sounds like she has herpes from it.. now I’m afraid of my husband ever going down on me again if it can cause herpes so easily. He says he never really gets cold sores, but I’m just feeling paranoid now. So my question is, how long after a cold sore is gone would it be safe for him to go down on me? It seems to me even though it’s gone, it might not be safe just yet still?