How young is too young

I am 23 and am falling for a guy who is 18 years old, he is really mature for his age but I am really scared about the judgement that will follow... 😬😢