Annoyed

My SOs aunt and uncle are living in right outside our bedroom... We got into an argument the other night with his uncle. His uncle went and told her that we said that she was a bad mother and shit like that but all we did was say we would just like to know if you're going to leave your daughter here, especially if we have plans. Her daughter is 3 years old and she loves us like crazy and vice versa.. Now his aunt won't let her hang out with us anymore...