Boyfriend’s racist cousin... should I have said something?

My boyfriend and I went to visit his 4th cousin at his house. He’s like 65 years old and an ex biker. All of a sudden he started talking politics and he said something about a black woman who is a politician and he repeatedly referred to her as the n word and bitch. Then he said she’s so fat she would need 3 jars of black paint for her skin. I was extremely uncomfortable as I am not racist and the n word is such an awful word. He also said to me “she would make the two of us look skinny,” because I am overweight and he is too. I didn’t say anything, I didn’t laugh at his racist “jokes,” but I’m wondering if I was wrong by not telling him to stop. I’ve only met him a handful of times. My boyfriend was there too and he’s not racist either but he didn’t say anything. Was I wrong?