Overweight and losing weight while pregnant?

I'm overweight to begin with. I lost during my first trimester and then started gaining some at 13 weeks. By 21 weeks I was up 10 pounds. Well now I'm 24 weeks, stepped on the scale and I'm down nearly 5 pounds. I'm guessing that since I'm already overweight this isn't an issue? I see my doc in a few days and will obviously discuss it with her...I was just seeing if anyone had any thoughts