He goes out while i'm pregnant

Basically, my husbands best man has broken up with his long term girlfriend and hes gone completely off the rails. He has been having parties & drug fueled nights out since they broke up. I am currently 19 weeks pregnant with twins & i work as a nurse. I got home today to find my husband had gone to the best mans house (which i was a bit uncomfortable with but didnt say anything). I then get a text off the best man asking if my husband can go to nightclub tonight with him. I don't like drugs and i know there will be drugs there if he goes out- not just a bit of weed, i mean coccaine or pills. My husband lied to me in the past about doing drugs & i don't 100% trust him since the lies. Ive said that i'm not happy about him going out with him and now he's turned this back on me. Saying i'm being unfair not letting him go. I haven't said no, i've simply said to stay at his best mans, not to come to my house tonight as im pregnant & working at 6am. Am i in my right to say this? And not to trust him?