Talking to someone

Hi everyone I have a 4 month old son and talking to someone. My baby daddy and I don’t have a relationship; it went dead over a year ago due to the amount of cheating and disrespect he will give me. There’s this guy, he has a 7 month old daughter, that I’m talking to on and off for about 2 summers. I wasn’t interested since I was with my baby daddy and he respected that and let me be which I was thankful for. We recently started talking again for the past few days, and I told him that I’m really damaged from my last relationship and I have my walls up. He said that he understands because he knew what my baby daddy did to me. Fast forward to today he FT me and I pick up and say jokingly “what you want” and he didn’t like that, but that’s what I do to everyone and nobody has a problem with it. I told him I’m getting a bbl and he told me that I’m going to go do me after I get the surgery and forget about him. I said no I’m a very humble person that doesn’t change my personality. He said it doesn’t look like I’m digging him because I’m “mean” and not showing affection. I told him that I’m digging him and I just have my wall up. I’m just protecting my heart from being broken again. I really like him a lot, but it doesn’t seem like he understands why I’m so guarded. He’s expecting me to be all lovey dovey from the jump but that’s not me I have to get comfortable first. We haven’t talked in a few hours and I lowkey kind of miss him. Am I being to mean? Am I in the wrong? What should I do?

I forgot to mention that our kids will not be involved at all. We will not be meeting each other kids.