I'm coming between him and his kids and I feel guilty

So my boyfriend has 4 kids from a previous relationship. Ages are 5, 8, and 9 (the 8 year Olds are twins)

He and his ex were never married nor did they ever get to the point of being engaged. He gets his boys every other weekend (Friday night to Sunday night/afternoon) and he does pay child support and most of the the time at random he gets to see them or spend like a Wednesday night or take them to practice or stuff etc. So he's pretty involved when he isn't working.

I've obviously met his kids, they're great. And when they're here I'm actively involved i don't just sit back and observe. Like I'm there making everyone breakfast or helping with homework or taking them out to the park with the dog, and doing things sometimes even without my boyfriend such as taking one of them to a friend's house or to the mall or stuff. I treat them like they're my kids but I do not throw myself at them and I like to think that they're comfortable with me. Don't get me wrong they don't call me mom but they will hug me and if we are all on the sofa watching a movie one will like sit on my lap and stuff.

Anyways he and I have been living together for about 10 months now and we are pregnant (I'm 5 months along)

And I had a bit of a rough go last month and was very sick for over a week and went through moments where I forgot where I was. So like a decent person my boyfriend was like I'm taking you to the hospital right now.

Well they kept me over night (a Thursday afternoon into a Friday) and he called the mother of his kids saying that I was in hospital and he asked if he could get the kids Saturday instead and take a shorter weekend.

She flipped out on him saying that I was taking too much of his time and that the boys were more of a priority then me (the new girl) and his unborn kid. She told him to man up and be responsible. When he told me this i insisted that he go home and get the boys and stay with them and that I'd be fine. I told him I never wanted to come between him and his boys. But he said he wouldn't leave my side and also said they know he loves them and if he said that I was sick they would understand.

He ended up staying with me yes. But his ex was livid and was screaming at him the next time she dropped off the boys blaming everything on me.

I'm so down about it. I feel guilty. Like I should have taken measures to not get pregnant. I feel awful