Too worried about those three little words?

It has been weeks and weeks since I first told my boyfriend I love him. It was a tender moment, really sweet, and his response was, "Yeah, I figured." Like.....what? And since then he hasn't said anything about it, and when I tell him I love him he brushes it off or he says "Do ya?" in a playful manner. I don't want to say, "Hey, when you are certain you love me, please tell me because my anxiety is making me a little obsessed with the whole ordeal." But that is what I am thinking. For some context: We are extremely close despite our fresh relationship. He does shower me with affection. He is constantly saying he is so happy and that I am his forever. I had a really insecure moment feeling like I wasn't good enough for him or that if I didn't keep him hooked I might lose him and he got very serious and assured me that was not true, I am more than enough, and he won't ever let me go. In a nutshell, his behaviour is evident of someone who loves his lady a lot. So what is the hang up on actually saying he does? In a conversation I all but asked if he loves me and all he said was, "You tell me." Am I being totally stupid here? It feels like I am, and that I am worrying over nothing. And yes I know each person has their own timeline for saying it.