My man sarcastically calls me fat...is he hinting at the truth?

Ive always been insecure about my body, even though im healthy weight and muscle tone. My boyfriend thinks its funny to call me chunky, but then showers me with compliments when i get upset. How can i tell if he really thinks i need to lose weight or of hes just poking fun? Or how can i get him to stop?