It's me

So, after a ton of blood tests it turns out I've missed one cycle and am late for this one because I have too much testosterone. I'm feeling really down today. My doctor is referring me to a specialist but until then I just wait and feel guilty I guess. 
I don't get it. I have kids. He hasn't yet. How can I possibly be infertile after having kids?  He's going to make such a great dad and I feel like I'm denying him that.