Pacifier

My daughter just recently turned 4 months and sleeps in her own room. Starting at around 1:30/2am she wakes up yelling for her paci to be out back in her mouth and every hour after that. This is after she’s been asleep for about 7/8 hours with her paci next to her bc she spit it out during her sleep. We try to let her fuss it out for a few minutes to see if she’ll soothe herself to sleep but we end up just going to put it in because we are just so tired. She falls right to sleep as soon as we pop it in. What do we need to do to have her sleep and not be doing this? TIA🥰