For those who have lost weight...did you gain it back?

12w+2 and have lost nearly 15 lbs. I'm still losing about 1lb per week. Did those of you ladies who lost weight gain it back? The doctor said "don't worry weight gain comes back with a vengeance in the second trimester." But with my son, the day after he was born I weighed 10 lbs less than when I got pregnant with him. If you comment can you give a little info like height and general fitness level. I'm 5'9" and weight 169lbs and am curious to see how this worked out for you guys.