I’ve said bad stuff while I’m mad but I’m curious….

While arguing my bf said “I really wanna punch you in your fucking face so you can shut the fuck up”

I flinched. Right when I flinched that’s when his neighbor came out to take the trash. She saw. She nodded her head. When my bf went back inside my neighbor came up to me and said “I think I’ll have to call the cops next time I hear that”

I told her he was mad but he has never hit me. Can my bf really get in trouble saying that or is it that bad