Not sure what to do after incident with my boyfriend’s family

Me

My bf and I (27f and 28m) went to his parents house for dinner and to watch a football game this weekend. For a little background we’ve been together for about a year, and just moved in together. I’ve only met his parents/family a couple of times and don’t know them very well. His parents, grandmother, and siblings were there. All of us are white. Everything was fine until after the game when we were getting ready to leave. I don’t remember exactly what it was about, as I tuned it out, but his father and grandmother suddenly started going off on some racist tangent and dropping the N word over and over and over again. The rest of the family was quiet but smiling, and seemed to agree with it. I looked up at my bf and he didn’t do anything or seem to be bothered at all. It made me very angry so I walked out of the house and waited for my bf in the car. He came out about 10 minutes later. He didn’t say a single word about it after. It’s been 2 days since and he still hasn’t said anything about it, not even acknowledging that it happened. I’m mostly mad at his family, but I’m also mad that he just doesn’t care at all. He definitely knew I was mad about it. I never want to see his family again after that. Which will probably be an issue because he’s pretty close with his family. So I’ve been quiet and not talking to him much while I try to figure out what I want to do/say. I’m not sure if I should break up with him, or just tell him to talk to his family or what. I plan on having a talk in 2 days (our next day off of work together). I do not tolerate racism, and am confused on whether his ignorance makes him racist as well, or just the fact that he is fine with his racist family. TYIA for any help