Overweight before pregnancy

I was overweight before I got pregnant and I am already uncomfortable with my body. I'm 24 weeks pregnant now and I've only gained 5 pounds. My doctor isn't worried but now I'm getting anxious that I'm not getting big enough. It just looks like I've been eating too much and bloating. It feels weird to be worried about not getting bigger.