Low testosterone and sperm count

So my hubby and I have been TTC for a while now. He was diagnosed with low testosterone a few years ago and put on testosterone injections. We did not know it would affect his fertility until I started doing research. He took a sperm test week and his count was low. Did any one previous have this problem? Not sure if we should see an endocrinologist or a doctor for fertility. Please help!