Not wanting to have a shower

We're expecting our first daughter & I really had my heart set on a baby shower but I've been getting a lot of bad vibes. I have a 2 year old and a 1 year old and my mom was saying things like "people are going to say she just had a baby". I had a shower with my 1st but not with my second. I really don't see what's the big deal, I'm married & financially able to afford to have another child but my mom and grams are so worried about what other people will think. It's really getting to me