Anybody loose weight in the 2nd/ 3rd trimester?

Sierra • Expecting baby girl Evelyn, Sept. 2016❤️
So I gained 10 pounds right away when I first got pregnant, and continued to gain weight in the first half of my second trimester. But I went to the doctors today and I lost 4 pounds. I'm about to be 29weeks. I eat pretty much the same, other than I cut back on sweets and junk food, could that be why I lost 4 pounds? I'm just worried my baby isn't gaining weight, because I'm not. My midwife is out of town and I asked the fill in doctor and all he said was I'm not sure just continue to eat healthy, but I just want an explanation