I’m torn as to what to do

Recently I went onto my husbands phone because I had a gut feeling something was up { yes I know I’m a terrible person save me the nasty ass comments} anyway I found he had another Snapchat that he blocked from my account so I wouldn’t see him and he was subscribed to all these premium and porn shit and had people added that I knew that do the premium snaps and only fans. I also saw a long list of people he was talking to and this one girl we will call her J was on there and he was talking about me in a bad way and was flirting with her and what not like while I was preggo he did this type of shit only he posted on Reddit, like private parts on Reddit. Had porn shit on there as well. Like I’m torn between telling him we need a “break” even though we are marred and or just letting it go and moving on. He always tells me he doesn’t know why he does it and that it’s his mental health and that he feels guilty while doing it like ok then stop doing it??? Like I’m at my end point