Husband alone with best friend?

My best friend was hanging out at my home. My daughter and I are about to leave to go out & my bf was using the bathroom and to leave right after. When I return home my bf was just leaving after 3 hours. I don't think they have anything going on but I think it's disrespectful to be in my home with dh when I'm not present.