Sexless Marriage

I searched before posting this and it was mainly women upset with their husbands but I’m on the flip. I’ve been married 5years and together for 7 and I have no sex drive. I don’t think I’ve ever had a roaring one and my hubby knew that up front but it went from once a week, to no sex when I was pregnant (twice) to now it will be months inbetween. I don’t think about sex ever unless it’s to think how my husband may leave me if I don’t put out (lol). But it’s to the point where I know he wants it (he’s told me flat out) but I’m just not arroused. I also am scared to even have normal physical contact like give kisses because I don’t want it to lead to more. I’m not turned off by my husband but I just don’t want to have sex anymore. (I’ll add I’m currently breastfed but if I if that plays a role either) I feel like I’ve trapped him and I don’t know what to do?! Divorce seems extreme but is that it?! What should I do?