Borderline sperm count

Just found out oh has borderline sperm count and needs to go back for retesting. We're both a bit upset by this news, although gives an insight as to why we haven't conceived after a year of trying. Has anyone else had this problem and still managed to conceive naturally? Every thought imaginable is going round our heads now and we're so upset