Relationship Advice

Hey ladies! I have a question. My boyfriend and I have been together for about two years and he is the love of my life, but we've been arguing constantly lately and it's because he has two friends that I do not like. Both of these friends do several kinds of drugs and drink like there's no tomorrow and I care about him so of course it's not the kind of environment that I want him around especially because he considers them his best friends and I know the influence friends have on you. But he gets mad at me and says how I don't trust him and how they have no influence on him, but ever since he started hanging out with them, he's been treating me differently so I don't know. Since we've started dating, I've lost all but two friends because of our relationship. Not because he's asked me to, but because he and my friend did not get along and it's just common courtesy and he means the world to me so I was willing to put above everything else, I still am. So now I really only have him because I barely talk to the other two friends, and that's okay because whenever I have him, he's all I need, but when we are arguing, I don't have him and I'm left alone. I guess what my question is is that, am I expecting too much of him to let go of his friends? He says how I'm ridiculous and if I cared about him, I wouldn't feel the way that I do and I feel like a horrible person whenever we argue and he has flat out told me that he is not willing to give up his friends, and he has even been willing to give up on our relationship for them.