swim/gym fears

I'm finally getting back into swimming at my local gym, but I'm always scared people are judging me when I workout *anywhere*. Tips for confidence about that, and how to not feel like the actual worst while in a swim suit?