Is it true??

Is it true that a mans sperm count can’t be fixed if their count is low?? My husbands urologist says thatvputting him on medication wouldn’t help his count. And that we need to see s fertility specialist? Any kind of info you guys could give me would be grateful. Thanks in advance