Confused...I slept with my ex

I admitted to my fiance that I did sleep with my ex during our 2 month breakup. So of course he took his ring back and says the only reason he didn't leave me is because I'm pregnant. He also have doubt that this it's his baby. I slept with my ex in October. I didn't conceive until December and the only person I was with was my fiance. I have no doubts about paternity at all. So here is my question. On one hand he says we can work it out but continues to talk about it almost everyday. He gets so upset all over again and starts calling me bitches and hoes. It's so stressful. I don't know what to say to him anymore. He literally will talk about it for hours. I'm sick of hearing my ex name. I don't want hin but my current significant other thinks otherwise. What would you do?