I’ll always be fat

I have a very curvy body shape and have lost 60lbs. I’m at 135. But it seems like no matter what my weight has been now or in the past I will never be “thin”. I’m a size small in most things and size 4 in pants. But I always get referred to on the bigger side because of my thick legs and people act like I’m lying about my size like I act like I’m thinner than I really am even though I don’t ever wear fitted clothes. Even my boyfriend will say I think I have something that will fit you and once I put it on it’s huge. Why’s everyone’s perspective of me so distorted? I’ve become so Insecure and with the realization that I’m just fat and always will be.