Family vs Boyfriend

Hey ladies. So here's my story. Okay it's been 3 years that I've been with my child's father. We have 2 children together. Our son deceased, 5 months now & our 2nd child currently still baking (yes I'm pregnant). Okay, long story short.....we hit a rough patch & I cheated on him, found out I was pregnant & we stayed together even tho things were bad. after I had our son, 4 months prematurely, we still stayed together but my family just didn't want to see us together. Now that I'm pregnant again, it's like they hate him even more. He has been there since day 1 with both children. But I found out that he cheated on me after we had my son.  I was very pissed at first but then I quickly got over it bc we both did wrong. But also 2 wrongs don't make a right. I love him to death, no doubt about that but I feel like everybody wants to ruin my happiness, which my happiness is with him. When I got pregnant with this child, my family tried to make me feel guilty & it hurt. I suffered for the first 2 months trying to figure out if I was doing the right thing having this baby. They don't even think I should give the baby his last name. And I don't agree with that. Everyday I'm going back & forth in my head trying to figure out if I'm doing the right thing or not. I'm just driving myself crazy now. I need advice ladies. Has anyone ever been in my shoes? How did you handle the situation? Do you stay with your man or just let it go? HELP!!!!