Weight won’t go up

I’ve always been around 137. When I got pregnant I dropped to 130 and now my weight fluctuates between 130 to 127 and it just goes between those two. I’m in my second trimester now and I did have a problem with eating because I’m not use to eating so much. So I did have to uptake my eating for baby. I just left the doctor and I’m 127 and so disappointed that I’m not gaining.. does that come later in second trimester? Should I worry?