Advice !!!

So I've met this guy through social media ... We use to talk then broke it off and now things are getting serious. I did look at him as a friend and would talk to him about my boy problems and now ... He's interested in me. He lives 6hours away from me and has a little girl. Hes honestly the sweetest guy I've ever talked to and so honest and open about his feelings for me and the only thing that bothers me is that... I'm 24 years old and he's 39. He's ready for relationship something real because things with his ex did not work out. And they only reason they stay in contact is because of their daughter they have together. Other than that he doesn't talk to her.... And I feel as if I'm not right for him because I'm so young and he's almost 40 and I'll be 25. So idk what to do ....
Honesty age and him having a kid and distance does bother me. But I don't wanna hurt him and not even try ? What should I do