Interracial relationship problems.

I am half Mexican and I have a daughter who is basically all white. Her father and I split up a looong time ago & im with a new guy. He’s black and talks about having kids in the future. My family has been making so many comments that my white daughter will feel out of place or if I had a child with him my black child would feel out of place. They also mentioned how “odd” all of us walking around together would look & it’s really irritating me. We don’t live together now but we plan on getting a place together in a couple months when his lease is up. I knowwwww my family is gonna have a fit about it & yes it’s strictly because he’s black.