Is age really just a number?

I had been talking (more like friendly conversation) to a guy since August we stopped talking all together when I found out his age (22). When he 1st approached me I told him that I wasn't looking for love of a relationship. He said he understood that. Earlier today I get a phone call and it's from him, he's professing his love for me and my children (3-10). He says that he's ready to settle down & start a family... Am I wrong for looking @ our age difference? I'm 31 and he's 22... Please no criticism... I'm just a fellow member with a general relationship issue.