Is weight a huge thing during pregnancy

So I am 29 weeks and so far have gained 24 pounds. Baby girl is measuring bigger then normal at 3 pounds because she got my chubbiness lol and I have to say I don’t eat bad I just eat a lot because im always hungry. My doctor only mentioned my weight this last time at my appointment and has said that I should only be gaining one pound in between appointments (4 weeks) and I have been gaining 8. I then come to visit my grandparents and my aunt is up here to and my mom calls my grandma and keeps her updated and my grandma tells my aunt. Well my aunt doesn’t think before she talks and she honestly makes me feel like crap saying that I need to watch my weight and anytime I eat something she asks if I should really be eating that much or eating that item. I like my sweets but only on occasion and she makes me feel like shit anytime I want to have a small piece of candy because my weight is already to high. She claims because she used to work in OB for the slightest bit that i should be listening to her. It’s put me in such a bad mood because I’m hungry which then makes me grumpy but then I try not to eat as much as i feel like I need to because I’m afraid of the judgement. So I guess my question is. Is weight a huge thing should I really be stressing myself out like this over my weight?