Can he kick us out?

H

Hi my bf father of my 2 babies went crazy because our mutual friend we hang out every day who’s his business partner said let’s go to dinner and I said 👍 I was going to the gym nearby so made sense. He my bf considered this “a whore behavior “ on my part and wants me to take the babies and leave!! I never went to dinner just the fact I accepted meant cheating...My family is in Europe so I have nobody to go to here. I don’t know the laws we’re in NJ can he actually kick us out forcefully? The house is on his name. He says go to Europe for some months until you find an apartment here...and said if I take him to court he’ll take my kids. I’m in total shock can’t eat just avoid him.. Also I’m unemployed.. thanks for any info