Is it wrong for me to be uncomfortable with my bf friends because they say racist things?

Let me start off by saying my bf is white and I’m a brown skinned Latina. He has this friend group of guys, and only invites me to tag along when it’s his best friend coming. I always thought it was strange so I asked why he never invites when the other two are there. He tells me it’s because they don’t have filters. I say what do you mean? He basically goes on to tell me that they frequently use the n word, and other racial slurs. Also that they make fun of other races, and stereotype others. All I said was “oh…,” and I kinda got quiet after that. I just don’t understand why you would want to be friends with people who think and talk like that. And in a way it gives me a weird vibe about my relationship with my bf.