Maybe no shower?

We don't have a ton of friends (some friends from our college group) and almost all my family are 8 hours away.
.
When I had my bridal shower I only had like 5 ladies show up. I'm really worried my baby shower will be the same thing. Thing is, I'm not even thinking this for the gifts. I love sharing memories with all of the people I love and I love parties.
.
Is anyone else worried about this? I'm thinking that my husbands grandmother is the one that will throw the shower, but I don't know yet. Who/how should I bring up my concerns?