What would you do?

So my husband has a guy friend who I actually really despise. I have been so nice to his friend for so many years when he lived in TN. So about a year ago he wanted to move to our state so we actually helped him get a place and he paid us back. I even got him a job at my firm. Btw he didn’t even last and quit like 2-3 months later. So fast forward to why I don’t like him. He basically showed his true colors when we found out that he is a big time druggy. I don’t judge anyone but I didn’t appreciate him guilt tripping my husband to hang out with him. He would act all depressed and stuff. So my husband felt bad. But it was getting so out of hand in previous months that I told my husband he needed to stop hanging out with him and hang out with his other guy friends who aren’t a bad influence. This kid seriously has a drug problem and I don’t want my husband getting caught up. In terms of being with him and getting pulled over etc So my husband did cut him off but now it’s like it’s slowly starting up again. His friend plays the victim a lot like poor me. I don’t appreciate him trying to start shit with our marriage. One time he was like that his friend saw a picture of my husband and said she needed to meet him. My husband quickly said I’m married and love my wife very much. We have a child together have some respect. So if his friend was a good friend he shouldn’t have even entertain conversations like that and defend our marriage. So basically he knows I don’t like him I have been so vocal about it lately. I have personally texted him and told him nicely to leave my husband alone. He acts like the victim and is all confused. So in the last 3 days I have been very mean I will say it to his face or over the phone how I feel. So tonight my husband asks if he can go to the casino. I don’t mind since he goes once in awhile. However when he told me who was going with him I said absolutely not. His friend heard me. I was like I don’t like you and stop being a bad influence. So do you think I was being too harsh? Or would you do the same to protect your family? I’m typically such a nice person and understanding. I let my husband have his guy time but when it comes down to that guy my blood boils.