Overwhelmed and heartbroken 2yrs later

So after 2yrs of TTC trouble my Husband and I did fertility testing. All our genetic testing came back fine, although his sperm count was 0.2 million out of the expected 15 million. I can't even begin to describe the heartbreak and disappointment I feel, not to mention the guilt. I want to have a baby so bad and I constantly find myself feeling guilty about wanting a baby. Guilty because I have a child already and I want him to have siblings and I may not be able to give him any. I have talked to our doctor and I don't want to do <a href="https://glowing.com/glow-fertility-program">IVF</a>, my husband is literally all for it though. I just feel like why should I have to put myself through the paces when I'm not the one who can't have children. I know it sounds horrible but husband has had a bad track record with taking care of himself before I came along and I contributed that to why he has such a low count. I want him to put forth more of an effort for us to have a baby. I feel like its unfair to put my body through <a href="https://glowing.com/glow-fertility-program">IVF</a> and he's not willing to try things on his part first (pills, acupuncture, life style changes). I don't mean this to sound so bad, I just want to feel like we have done everything we can minus <a href="https://glowing.com/glow-fertility-program">IVF</a>. I workout and take good care of myself and make sure that I feed my family properly. I have heard such horror stories about it and the lingering affects and I'm scared to death to put my body through it and still not be guaranteed a baby. God please give me the strength to get through this moment and bless us with a healthy baby when it's time.