Help, he's always kicking me out?

I'm temporary living with my bf for a couple of months because he's helping me take care of my kids while I work late night shift. He offered my kids and I to stay at his apartment until all my tardy/absent pts I have at work is renewed, that way if i ever get late, I won't get fired. Im at 1 more pt and I will get fired, but I can't afford to get fired.

I have a house, but I decided to stay with him, not just for his help, but also, because I want to be with him. I even offer him to come live with me, but he refused.

Anyways, Everytime we get into arguments, he will tell me to get out of his house. He's basically kicking me out without using force. And once I get out, he will blamed me that I left myself cause I want to.

Today, we got into an argument because I was messaging him, and he ignored my messages. But he was scrolling on his fbook. I ask him why he ignored me, and he said he already knew what I was doing, so he didn't say anything, and ask me what he was supposed to say to me.

I told him he could've just said ok, instead of ignoring me. I was going to let it go until he told me to get out of his house.

It hurted me a lot that he would always kick me out Everytime we get into arguments that shouldn't be big. He never wants to communicate and come to an understanding. All he will do is tell me to leave, and that he doesn't want an insecure woman.

But he is insecure himself by not letting me wear certain clothes. All I was wondering was why he didn't at least reply back to me, but he was scrolling through Facebook, it made me feel like I'm not important to him.

Should I let him go? Am I overreacting?