Boyfriend

Is it bad that my boyfriend has joked about punching me? He’s definitely not abusive at all (like even if he accidentally nudges me he’s like omg I’m so sorry) but one time I asked him a question that annoyed him a lot and he was telling me if someone else asked he would punch them and another time I did something that annoyed him and he was like “if you do it again I’ll punch you” (I did it again and he didn’t lol) and he’s like pretended that he was about to punch me before. Idk i know he would never punch me but still is it bad that he would even say that