Belly isn't growing according to the wks i have. Help.

My doctor said my belly isn't growing how it should be. Is it harming my baby? I'm currently 32 wks. Has anyone experienced this? If so what happened. I'm worried. My doctor is holding of on another ultrasound.