Does age really matter?

Okay so I've been speaking to this guy on and off for about 5 years now and but we have only met a few times. He's 6 years older than me (I'm 19 btw) but I just wanted to know if that is weird or will hold us back in the future.