Fiancé made a fat joke towards me, should I be upset?

My fiancé and I have been dating for almost 5 years now, and we are really close. I love him so much. When we first started dating we were both average sized. I’m 5’7 and back then i weighed around 130 pounds. Over the years, from struggling with stress, binge eating, and lack of exercise, my weight has risen to 189 pounds. I know I’m overweight, and i’m working on losing it. My fiancé also gained a lot of weight last year when he was in a dark time in his life. However, after he got a new job and started eating healthier, the weight seemed to melt right off of him in only 6 months and now he looks great at nearly same weight as I am. (he’s 6ft and 190 lbs) He knows that I am really envious of his easy weight loss and that I am very self conscious of my weight. Recently he’s made some comments about it, and most of the time it doesn’t bother me because I know that i’m not healthy and need to do better, but he made a joke today that kind of hurt my feelings. We were play wrestling, and at some point, I ended up on top of him. He said that it was unfair because “obviously I had a weight advantage”. Again, we are the same weight. And the way he said it just seemed really mean and it got to me. I told him that he took it too far and went to go take a shower. I come back out and the only things he has to say is “he didn’t mean to ruin my night” and “he wasn’t calling me fat”. I still feel really hurt and i’m not sure what to think. Any advice/comments would be appreciated. ❤️