Am I wrong for this?

My boyfriend and I got into a fight today about one of his friends. Last night as we were all hanging out my boyfriend's friend makes the statement "if it doesn't matter I don't care" after his girlfriend said "I want to tell him everything but he says he doesn't listen to me if it doesn't matter" and my boyfriend agreed with his friend... it makes me feel as if he does that to me when I talk about my everyday life. Does he listen when I speak? I try to listen when he speaks even when it's the same thing I've heard everyday for the last 2 years. I still listen. And when I brought up the fact that I was trying to defend his friends girlfriend he felt as if I was talk badly about his friend, which I don't appreciate that his friend was being a complete douche about it the whole topic. Basically saying that our lives don't matter. Then I just felt as if it was kinda unfair to say something like that and expect me to be okay with all of it. I just asked that if he was going to think something like that, that we keep it to ourselves. I don't appreciate it and I actually got offeneded. But all in all I told my boyfriend to forget about the whole fight and I apologized for getting upset and we stopped. But am I wrong for feeling like I should have his side? I feel as if he doesn't listen to me now. I don't know what to think and I'm just looking for different ways to just bite my tounge because if I don't this will end in chaos. But am I wrong for getting upset? It just doesn't seem right to me...