Need opinions!

So is it weird that I'm dating a guy that's 14 and I'm 16!? I get crap about it all the time and it's annoying but I'm absolutely crazy about him and I don't care what anyone else says about us! But you know it still kinda bothers me!