Small baby but apparently I'm fat

Just got back from my 28wk appt and had a growth scan, baby girl is measuring small (38th percentile) yet the doctor (who is not my usual doc) told me I can only gain 2 more lbs for the rest of the pregnancy. Mind you I had a meltdown that my poor husband had to witness prior to this appt because nothing fits right and I just feel fat, but then to have the doctor tell me (in my head I hear) that I'm fat just broke me! I cannot stop crying today and it sucks because we got to see my beautiful daughters face and she even smiled for us! I know I'm not obese, but pregnant and   Gaining weight for my babe, but man oh man are these hormones getting to me! I'm hoping baby girl can continue to gain while I can maybe stay around the same weight, but not sure how that's going to work out :/