My bf and I don’t agree

My boyfriend experimented with drugs when he was in high school. And when he talks about it, it turns me off. He just started telling me a story about it and he could tell that I didn’t like hearing about it and he got mad at me. I can’t help it but I find it so unattractive. If he did it now, I would break up with him. Honestly I hate that he smokes weed. But if he did anything else, I’d definitely break up with him.

I am so against drugs. I don’t want anything to do with it and his view on it clashes with mine.