Feeling distraught

My husband and I have been ttc for almost a year properly and I've been off the pill for almost 2. Found out today that he has a very low sperm count which is why I haven't fallen pregnant yet. We had to find out by going private as the national health service didn't even bother testing him when we went to see them. I'm so angry and worried that we'll never be parents. Is there any success stories out there???