Age gap

I know there's a group for this topic, but people don't post often in it.  My boyfriend is 14 years older than me. Im in my early 20s, he is in his early 30s. We've been together over 2 years and he just confessed tonight that everyone in his life gives him crap for being with me since I'm younger and that they don't think we're good together. I asked him who said that and he said literally everyone, except for his mom who loved me. So this means the rest of his family, and all of his friends.  I was under the impression that they all really liked me but I guess they told my bf differently. My family doesn't really like the age gap either but they haven't met him yet so I know when they meet him soon, they'll see it's not as bad as they thought. But all of my boyfriends family and friends have met me, and they still don't think we're good together because I'm younger. I used to not care what people thought about it but now, deep down this really bothers me.  My bf says it doesn't matter to him what they say, he loves me anyway. But I just hope they don't fill his head with things and convince him they we shouldn't be together. :(   can anyone  relate? Or have any advice? Thanks