Should I be worried? Read description

So I’m talking to this guy and he seems to really like me but we were talking last night about who made the first move. I kept saying it was him because he asked for my number but then he was like “I didn’t even want you at first, so you definitely made the first move”..... it kinda threw me off.. like.. he didn’t want me? Idk it just seemed kinda weird and it made me feel weird. Now that makes me think he doesn’t want me and is just talking to me cuz he’s bored. On the other hand, he does seem to really like me and doesn’t treat me differently around his friends (still calls me baby, kisses me, etc) and he loves making time for me, so idk