Can Age Really Matter?

So I started talking to this guy about a week ago. And I know it's been a short amount of time but we both really like each other. We went on a first date and have a second date set up for Friday. We've held hands and kissed already. He's 23 and I'm 19. I don't mind the age difference. And we both want a relationship with one another. 
Yesterday he told me that the age difference is a problem. And if not now can be down the road. He doesn't want me to be in bad situations because of him. And he doesn't want me to get hurt. He explained to me that his past relationship was abusive. His ex forced him into many situations. Including marriage and having a child. He's in the prices of getting a divorce. And his daughter is three. But none of this scares me away. And I understand all of it. It doesn't scare me away. I like him for who he is. And all of this that has happened to him makes him the man that I like and enjoy being around. 
But is this really just an age gap issue or could it be that he thought that me finding everything out would scare me? 

Glow Resources

Let’s Glow

Glow is here for you on your path to pregnancy

Glow helps you navigate your fertility journey with smart tools, personalized insights, and guidance from medical experts who understand what matters most.

25+ million

Users

4.8 stars

200k+ app ratings

20+

Medical advisors