Pacifier help!

We put our six month old to bed with a pacifier and throughout the night, it will fall out of her mouth and she’ll start crying/fussing. So we’ll get out of bed to replace it and the process repeats several times throughout the night. We’re getting tired of doing this though. How do we overcome this issue? If it’s relevant, baby only uses a pacifier while sleeping.