Gonna ask my doctor but..

So I have been to a doctor and confirmed that I have genital herpes. (I've known since 2013) and I enjoy performing oral sex on my man. He's been with me since before I knew I had it and we assume since we've had unprotected sex(he's the father to both of my children) that he's probably got herpes as well. Can we do oral sex? Obviously during an outbreak we can't but if there's no sores or anything can I? I'm paranoid of passing it on to my kids.