Daddy?

Today my boyfriend was was messing around and whispered "call me daddy" in my ear and it took me by surpirse because I've always been scared to tell him I'm a little. So I turned around and said "what" and he just laughed and said that he was joking and that that it's kind of weird. But its hard for me because he does act like a daddy sometimes. Idk it just drives me crazy.