Ex and visitation

My ex husband and I divorced 8 years ago. HIS friends and family informed me at the time that he was on meth and not to let our daughter have visits with him. I mentioned it to my attorney and she put in the parenting plan that until he passes a drug test then she is with me 365 days a year and him 0. I tried to contact him during the time we were separated before the divorce finalized so we could talk things out about the parenting plan but he avoided me. I called his family and told them that he needed to do his drug test and when our court date was just to make sure that everyone knew. He did not show up so therefore what was written down is what was ordered. He has contacted me a few times over the years to see if we could get things changed so that he can be in her life, but it's only when he has a new girlfriend. When he is single he doesn't contact me. Now, he has a crazy one, who texts me out of the blue telling me that I'm wrong for not letting him around, but I have tried to explain to her that in our state, if I go against the parenting plan, I could be held in contempt of that, and get in trouble, and that I'd be more than happy to work with them after I get legal advice on things, etc. She will mouth at me for a few hours about it, and then on important days, like our daughters birthday last week, they won't even text to say they said happy birthday or whatever. It's just very irritating to me that she wants to make me look/feel bad about things that happened before she was even in the picture, but not put in any effort showing they actually want to be around. Am I wrong? Because they really make me feel like I'm horrible when I know I've done the best I can at communicating with them.