Stopping pacifier cold turkey

He's almost 4 months old. He is now CONSTANTLY waking up at night ONLY because the pacifier isn't in his mouth. At first I thought it was because he busted out of his swaddle, but Im convinced it's his pacifier. It looks like it's time to stop using it if I want to sleep at night. Do you have any helpful tips and how long it took your baby to get used to no pacifier when stopping cold turkey?

I'm starting today with naptime and gonna give him one of those comfort mini blanket things.