Noise and baby's hearing

Abby
So I've read about being careful to not expose baby to loud noise.. Our church has a praise worship band and the room is pretty small so it can get loud.  
Has anyone taken their LO to church and if so, do you have them wear protective earmuffs?  Or am I just being over-protective?