Is it abuse?! Or is it just him being annoying???

My step dad touches me all the time when I tell him to stop. It's not in a sexual way, but he will kiss my head, pull me to hug me and pull my phone away from me if he wants to hug me. I absolutely hate it and I tell him to stop it and I'm serious about it and it makes me break down because I have severe anxiety and he KNOWS I hate being touched and he'll just sit there and keep on doing it and say, "shut up I'm not bothering anything". I don't know what to do anymore and it is killing me because I CANT STAND being touched at all.