what is so wrong with me being in an interracial relationship.

So my boyfriend and I have been together for a little under a year and the entire time we have been together this has been happening so I was hoping someone could shine some light on this for me. We are an interracial couple. I'm short, blonde hair, green eyes and he is tall, light skinned, brown hair and eyes. I never saw color with him. He's been my best friend for years and iv been in love with him since I can remember. What I don't understand is why we get so many dirty looks? Doesn't matter if they are black or white, the glares and mumbled comments are unbelievable. Why is this an issue? What is wrong with two people being in love. Skin color has absolutely nothing to do with who someone is and it hurts that even in this day and age people still can't see past it. It doesn't just come from your "typical" old white guy either I actually get the worse of it from black females. Someone please educate me on what the issue is. I love him no matter what and no amount of racism is ever going to change that.