EDIT EDIT AGAIN Staying for the kids

So there was another post similar to my situation. My fiancee also expects me to text him AT LEAST every 20 min while he's at work. Even when he doesn't reply, just send him a text every 20 min no matter what.

Earlier today I got a call from a telemarketer, at my phine nunber and answered and hung up, my fiancee called me at the same, on FB so it went to voicemail. Like I was on the phone with the telemarketer for like 5 seconds. Hung up and called him back right away. And he was upset I was "on the phone with someone" just now I was on the phone with my brother, my fiance called so I hung uo on my brother and called him back right away. He said "fuck that that's the second time you've been talking to someone when I called get out of my house" he threatens to kick me out every time we argue cause "its the only thing that catches my attention" he always says "my son is staying here" and I have 2 kids, the oldest isn't his and he only says that about the baby. Even the he claims my oldest as his. He says I'm "acting shifty" and I don't see how. I stay at home 24/7, since I'm a SAHM. He has always questioned my loyalty since day one and I've never given him a reason to. I've change myself 100%. I've been faithful since day one. I just don't know what to do anymore. I honestly love him with all my heart and don't want anyone else. But I feel like I'm only in this for the kids at this point. I do want everything to work out but I don't know what's going on anymore.

Edit: also the baby is 6 months old, he comes home from work and barely spends time holding the baby. He gets in the shower, rolls up, plays with the baby for about 15 min, the plays his game until bedtime. When I make his dinner I have to take take baby with me cause he needs to "smoke first" which would be no big deal but I have the Kids 24/7 and only get a couple min break when he gets home. Then when I say "the baby is gunna stay in here with you while I cook" he says "seriously, I gotta smoke and play the game I've been at work all day" like I've been doing nothing. I feel extremely unappreciated.

EDIT: He works from 4pm to 1am. So my oldest never hears us argue cause we don't yell. So he doesn't hear when he says "my son" and not "my sons" I guess that irritates me the most.