Does age matter when it’s 5 years apart?

So I’m talking to this guy at work, he’s super sweet and very down to earth. Only had lunch together a few times nothing outside work. He wants to go out for dinner and drinks but I just found out through another coworker that he is only 29 and I’m going on 35. Which he looks much older and acts more mature than most men I know. Should I tell him I feel weird now that I know his age?! Or does that make me look like a bitch.