Should i divorce him?

My husband and I have been together 6 years. We went into this relationship knowing I wanted more kids. My kids are 13,14…his is 14. We thought this whole time my tubes were blocked but after 2 hsg test they were completely open. Finally he went for a semen analysis and he has low sperm morphology. I brought him vitamins to take and found he hid half the pills and said he had been taking them. He refused to take them now and says he is not the problem and it is me. I’m so hurt and upset idk what to do. He knows I really want another child but doesn’t want to atleast try the supplements. Any advice???