would u be upset if ur husband said this?

We're sittin on the couch watchin tv n hubby cuddles next to me n rubs my belly. He says, "are u pregnant again cuz ur belly is pretty big" ... I'm workin full time, takin care of our 7 month old baby, who is EBF n eats every 2 hrs, cookin dinner, doin homework with our 8yr old, tryin to pick up around the house, get both kids bathed n in bed by 9, do my own school work n classes online, n be in bed myself by 1030 to get up n do it all over again the next day. Im 5' 5" n was 205 pounds when I delivered. I'm now 172 n I honestly haven't been tryin to lose weight, cuz I just don't have time in the day to exercise. My school is my number one "me time" priority. I was feeling so confident in my big curvy girl body, but now I feel hurt n insecure bout my body n weight. I don't think he intentionally meant to hurt my feelings, at least I hope not. But now I lost all my confidence I don't even wanna go out of the house anymore. 
JUST TO ADD before ppl Start questioning. Hubby works 10 hr shifts so he's gone most of the day. That's why I do most of the work. He does mornings with the kids.