Sensitive or in the wrong?

My boyfriend never calls me fat or makes direct comments about my weight. Sometime though he makes little remarks that genuinely hurt my feelings. For example today we were eating pasta and I was sprinkling cheese on top. And he's like "damnnnnn". I got really upset and left the table. He didn't care and was like you're way too sensitive.