Need tips advice on losing pacifier!

Chelsea

So my 5 month old has been a star and night sleeping (excluding the 4 month sleep regression!). She goes to bed at 7 with her paci and wakes up around 6-7am. We normally have to replace the paci once. Well recently she wakes up "crying" for it every 2 hours or so! She's not really crying, sort of fake crying. We have recently dropped our night feed, she is also teething and going through a leap.

So I am searching for some advice to losing the pacifier at night. We've considered stopping cold Turkey or pulling it right before she falls asleep. She has to have it for naps so please don't suggest to start with naps...