Thumb sucking and pinching?

Hey all, so my LO is 10 almost 11 months old. He sucks his thumb. Totally refuses a bink. Wouldn't take one even when he was a new born.

Anywho, he sucks him thumb all the time. I wish I could get him to stop but I figured it was just a phase and didn't wanna worry about it to much. He is little. Well I recently saw on the top of the inside of his mouth is a large sore! He is scratching the roof of his mouth while he sucks his thumb to the point of breaking open the skin!

Along with the thumb sucking if he gets tired he starts pinching his neck also. But he has started to leave little red marks 😢 How do I stop these bad habbits!!!