Boyfriend asked me to lose weight...

He always made comments about how disgusting fat people are and he doesn't understand how people let themselves go but he got drunk and finally came out that my weight bothers him besides being completely mortified and embarrassed I have no idea what to feel and how to react I am chunky but not obese to where it is a health concern. We don't have sex as much as we used to so I figured my weight was bothering him but i guess it hurt more to hear him say it out loud.

Edit * I have not gained weight since we began dating I have always been the same size from the beginning so it's not a "I let myself go" situation I have always been a little more fluffy.