Visitation Rights

In the event my DH whom is estranged from his family, gets into an accident that lands him in the hospital unable to make his own medical decisions. Do I have the authority as his medical power of attorney to deny visitation from said estranged family? I'm not saying that I would, I would make the best decision for my husband and his recovery etc, I'm simply just asking for an idea.