Weight loss during pregnancy

So I was told I have GD early on in my pregnancy BUT they said more than likely I had it BEFORE I got pregnant since I had it so early which I think i found out at 14weeks. I’m 21yrs old 5’1 and starting weight was 216lbs. Since changing my diet and such I lost 17lbs so far (currently 20w 5d) and people are noticing but I’m getting alot of comments like “aren’t u suppose to be gaining weight not lose it” or “is that healthy for the baby” and it’s making me worried. None of my doctors have expressed any concerns about it so idk why others have too. Any other mommas lose weight during pregnancy ? It’s not my goal to do so but it’s just happening because of my diet change. I eat small meals every three hours because I have to keep my glucose levels stable.