Boyfriend not affectionate enough

So me and my boyfriend know each other years and I've liked him the whole time well a week ago he asked me out and claimed his liked me the whole time and was trying to ask me before but the thing is his not affectionate enough, I text him saying I miss him or call him hunnybun or something and he just says "hm", does he not actually like me? Am I overreacting? I've confronted him and he says relationships take time, am I just to impatient?