I dont like my boyfriends family that much, is that bad ?

I don’t really like spending time with them because they always make comments that make me feel really uncomfortable or sometimes say rude things. My boyfriend always makes me stay there for a long period of time. (Bi-racial couple) his dad sometimes says Things about Mexicans when I’m not and says things that I take offense to. His mom is nice but he and his mom have a tight bond. I’m not really a family person because my family is always fighting or never together. Idk what I should do because I don’t want this to take toll on my relationship. He doesn’t seem to understand my feelings and it makes me even more upset. Am I overreacting or what? Idk what to even think

Edit: he always warns me about the comments they will make and expects me to be okay with it. Also he has family 2 hours away from here and when we went to visit, he left me all alone with strangers. Ever since I don’t want to go over and now his other half of the family doesn’t like me, I suppose. Im at a loss