2kids,2women has to ignore me to respect them

If you had a guy who you were involved with and having sex.you share a mutual love for one another but he has two kids by two women and cant answer or talk to you in their presence what do you make of that?

He says its disrespect to talk to a woman in another womans home even though he isnt attracted to or involved with the woman( mothers of kids