Cold sores and sex?

I recently got my first cold sore ( what I think is a cold sore anyway ) I'm aware when you have an active cold sore to not kiss or have oral sex but what about when I don't have one? Is oral completely out of the question for me and my boyfriend now? He doesn't suffer with them so I'm terrified of passing it on to him. I'm so upset and freaked out by it all..