Please help !!!!

My boyfriend and I have been together for 4 years, have an 8 month old daughter and I'm 7 months pregnant with our second child. We broke up for literally one day back in October and I just found out that he has had sex with another woman multiple times since then and that the woman is 2 months pregnant with his child. He said it only happened once and that the child isn't his but she's saying it was multiple times and that the child is his and that he is trying to convince her to get an abortion. I immediately put him out and haven't spoken to him since I found this out but he keeps texting me saying he is sorry and that the reason he didn't tell me is because he didn't want to hurt me. He then goes on to say that it's I a way my fault because I act crazy when I'm pregnant and that he was under alot of stress when me and him broke up for that one single day.i know I'm doing the right thing but why do I feel so guilty about it? He also said that he doesn't wanna see his kids we have together if I don't wanna be with him because it will hurt him having to see me at pick up and drop offs. He is literally acting as if I'm the one hurting him and I don't wanna be the bad guy but that's a deal breaker for me. Any ideas how not to feel guilty and completely cut him off for good? It's hard but I'm willing to try anything because this is the hardest most gut wrenching thing I have ever been through and all I wanna do is cry and although I wouldn't do it I am feeling a bit suicidal.