Husband is ruining sex for me

My husband is a sex addict and is on the path to getting help. I know it takes time, but after putting up with it for 6 years I have little to no tolerance for it. I used to love sex. Sometimes I think that if I had sex with someone else I might enjoy it, I may not have to force myself into it, and I definitely wouldn’t need lube. No I’d never cheat, but I do fantasize about enjoying sex again. My husband and I just found out I’m pregnant and our youngest is 9 months old. This last pregnancy did a number on me in many ways and I asked him to get a vasectomy and he agreed but never got around to it. With 2 kids, we have sex every other day or every 2 days at least. So a decent amount. Yet he still says it’s not enough. We used to have sex once a week so I ended up compromising and said every other day. But here we are and he’s not happy. Well since finding out I’m pregnant again I am unhappy. I love this baby, but I’m angry. I know it’s my fault but everything he does annoys me. Tonight he brings up that a coworkers wife takes a “female version of viagra” and said I should try it too. I reminded him that I’m pregnant and there’s nothing wrong with my sex drive. I want sex and I crave it, just not with him. I obviously didn’t say that but I thought it. I got angry that he said that. Idk what to do anymore but I’m sick of it. I’m only 26 and I want to have good sex and actually want it with my own husband.