How to keep pacifier in 3 week olds mouth?

Decided to try a pacifier with my 3 week old, he loves it but I'm regreting it right now lol. He doesn't know how to keep it in his mouth. It falls out and then he cries until we put it back in....this is all night long too 😭 I've tried all different kind of pacis including the wubanub and nothing works, he still drops it out of his mouth or knocks out with his hands (it's not because he doesn't want it) Any tips on how to keep it in?? I need some sleep tonight!!