Advice needed please ?

Ok so my kids dad has a child w some bz before me and when we were first together he would bring his son over and he would bond with my sons , time went on and we were expecting a child together. During my pregnancy he was disrespectful he would put me through hell and I would ask why are we together well we stayed together and after I had our son he would spend the night at that bitches house while she had a man and he all of a sudden started bringing her son (hers from another relationship) and his son over to my house it was like a slap in the face to me he was watching her kids I understand her son but he never had the other little boy around . It would hurt me because he would come over whenever but spend the night over there yet we were together. Well it’s been a while now since he hasn’t done anything like that to me we are expecting our second child together within weeks ! So today he comes over with his son and his bms other kid I text him and said not ok. So he left because he knew how I felt about him playing baby sitter . I haven’t called him or text him idk what to say to him I feel like that just put me 10 steps back I feel hurt and I swear p GOD I will not be treated like he did to me before .