Dr mad about weight loss

Rachel
I'm 13w4 days and on the fluffy side 😜. At my first appointment I was down 16 from my last appointment before I got pregnant. I was down another 6 at my most recent appt. I just weighed myself and am down another 2 since Tuesday!
He wasn't happy with my 6 lb weight loss already, and acted very skeptical when I told him I haven't changed my diet, exercise, etc...I just can't physically eat as much as before. 
Anyone else have this problem? How did you stop losing weight?