How old is to old? 🤔

I’m 22 and the guy I’m talking to is 40 ... I’m having mixed feelings about this .. age shouldn’t matter right ?