Is it wrong for a senior to date a freshman?

We have always been friends and he acts pretty mature for his age, but people (majority the freshman) giving us a hard time because he chose me over another freshman.