Selfish Parents?

My husband & I have decided that we do not want our kids going over to my parents house. It's not always clean, they are heavy smokers and my older brother is a drug addict and still lives there. On top of that, my brother steals anything he can to sell/pawn and we can't even leave our cars unlocked in the driveway or else he'll steal money out of our wallets. If I can't trust him near my car, why would I trust him around my kids? As if this wasn't enough, my dad is an alcoholic and him & I do not get along. I am very close to my mom and I wish she'd just move out and be happy again, but she stays. As a result, I won't let my kids over there. They don't need to be hanging out in that kind of environment. My mom says I'm being selfish and it's not fair that my husband's parents get to babysit over night if they want to. If mom wants to see them, she has to come to our house and babysit at our house. She feels I'm not allowing her to have a relationship with her grandkids, but she lives 2 miles away and is more than welcome to come over anytime. Am I being selfish? Or am I being reasonable here? I just want what is best for my kids.