nervous about weight

I'm a pretty chubby woman I weighed about 184 before I got pregnant . Could be less could be a little more . But yesterday at my appointment she said I weighed only 181 . I know it's not much and we heard such a beautiful heartbeat on the Doppler so I know baby is okay . But with my last pregnancy that I miscarried i kept losing weight before I even found out. It was a mmc at 12 weeks , but baby didn't make it past 8 . I'm 10 weeks and 1 day and further than I've ever been . I shouldn't worry right?