very low sperm

My husband and I have been TTC for almost 2 years now. The fertility dr is quite the long process. We just found out that I'm perfectly fine but that he only has 4 million Sperm and 50% of them aren't doing anything. We are about to start a series of male vitamins and injections. I feel like our dr is Trying to push invetro on us. I need to know if there's hope for us with such dangerously low Sperm.