Scolded for gaining 4lbs

So my doctor scolded me for "gaining" 4lbs. My last appointment was 2 weeks ago and up until today I hadn't even gained 1 pound this whole pregnancy. I'm 21 weeks and I had literally just gotten done eating lunch before my appointment. I get that they don't want a woman to gain too much, but being scolded for the first 4lbs in 21 weeks of pregnancy??? That's a way to ensure a woman makes sure to take care of herself while pregnant.... Make her feel even worse about her growing belly.... Anyone else ever have this problem??? Kinda pissed me off! I should also mention I'm pregnant with twins.