Cold sore treatment while pregnant?

Ta

I have a cold sore coming in 😣 I have a prescription for Valtrex, but don’t feel safe taking it until I can talk to my doctor and their office is closed. Is it safe to use over the counter medicine like Abreva? I’m 6 weeks today.