Bridal party... what do I do?

So my fiancé and I were talking about our bridal party. He has 2-3 men he really wants to stand with him on our day, my problem is that I absolutely just don’t have anyone to ask to match and I’m so nervous I’ll have to tell him we have to forego the idea.

All the women in my family are much much older than I am and I feel as though it would look awkward and just out of place.

Any thoughts?