Weight loss?

Is it normal to lose weight at 32 weeks? The past three weeks now I've lost three pounds and when I went to the doctor today by baby hasn't grown any in a week. I was measuring at 32 cm last week, and once again this I'm measuring the same. I didn't get to see my normal doctor this week because he was delivering a baby, I actually saw a doctor I have never seen before who seems as if she didn't really have time for me. I'm really worried. With losing 3 pounds in 3 weeks and then my baby staying the same size should I worry?