My boyfriend smokes weed and it bothers me

Lady

This is just a rant, I feel like I just need to get it off my chest rather than do something about it.

So I have friends who smoke weed and I don't mind. In fact, I'm curious about it too like how it feels and all, but I don't think I'll ever actually smoke it. Just that when it comes to my boyfriend doing it, even though it's not often, it just worries me. He says its not as harmless as other drugs, and I don't have anything against that statement because I believe people can do what they feel like as long as it's okay-ish you know? But when he tells me that he's with his friends (which I don't like because their views completely contradict mine but he doesn't know) I feel nervous. I know that he only smokes with them because it's "fun" like he says yet he doesn't tell me, out of respect of course. I also feel like if I were to talk to him about it, nothing would change, I mean I don't control him and if he wants to keep doing it, not-so-fine by me but whatever his life, right? Idk I don't want to turn into a manipulative girlfriend or even be viewed like that by him. I put it in a sense where if it were the other way around, I wouldn't want him to tell me what to do so why should I? Especially now since he just went off to college where he can be independent but also get a start to his future career. I'm proud of him don't get me wrong, but my only pet peeve of him is that he smokes weed.

P.S. I never liked his friends before I even dated him...but that's a different story. Also, I just want to point out that he is definitely not like his friends either, otherwise we would not get along.

Thank you all for listening haha