Lost Weight and Barely Gaining Any

Kim
I lost about 8 lbs ever since I found out I was pregnant until about 27 weeks. Then my September appt I was told I gained almost 3.8 lbs. I just had my appt today, 3 weeks later and only gained 0.4 lbs. I'm 30 + 2. I don't know if that's even healthy. I feel like the weight I gained was just the baby getting bigger. I'm worried this will affect the baby somehow. I was told by the dr that I should be gaining the weight this last trimester. I know I've had an increase in appetite for sure but I'm just not gaining enough weight in my opinion. Has anyone experienced this?