Herpes

This is a weird question but say if I touch my cold sore, then vagina will I get herpes down there?? I'm not literally doing that^^. But say I masturbated or something while I have a cold sore.