is something fishy?

i am dating a guy who is separated from his wife. they have 3 kids together. one evening we were taking a nap in his house and i heard footsteps coming up the stairs. he jumped up to see what was up and it was his wife. she told me to get out of her house and not to park in her drive way. then she said to him ,i told you not to bring these hoes into my house.take them to a motel or something. then she said to me did he tell you about the other girl because you are not the only one. i did not say anything to her ,she did not physically try to attack me.she basically went straight for him. i left the house,but my bf did not try to stop me from leaving neithet did he tell her to leave. i felt really hurt because i felt he didnt defend me and the reason why i actually left was because i did not want to get in between them or caught in there issue. after i left he did not call to apologies or ask if i was ok? so i called about 2am that same night and asked why he didnt call. he gave me a bs excuses saying he was gonna call but he thought i was sleeping. is he cheating? is he still sleepimg with his wife? should i break it off? side note the wife has her man.