herpes or scare

So My ex was cheating on me with several girls and I got tested for the usual but not herpes. I had unprotected sex with a new partner shortly after and he thinks he got herpes from me. I never had any outbreak or symptoms of genital herpes, but I've been reading where it says some people may show zero symptoms at all. I'm going t get tests for herpes asap, BUT I have to wait a few months for it to show in my blood. How worried should I be?