He keeps saying "you're young!"

I'm 22 and I recently (April of this year) lost my virginity to a guy I'm casually dating. He's 39. And we get along great, but he keeps saying "yeah you're young, you'll learn" whenever we talk about any topic. And it just bothers me. He makes me feel like a child and I don't like that. I've told him before how he makes me feel and he says, "I'm not saying it to make you feel bad, it's just the truth." It's annoying, I really like him but I don't know if I should keep up with those remarks or just give up on him?