Pacifier help?

I just introduced my 2 month old to a pacifier a few days ago, he’s never gone to sleep with one and I’ve only used it a few times a day to soothe. Well now I want to start using it more for bedtime and comfort during the night so he doesn’t use my boobs as one every single hour😫. Problem is it obviously falls out a few times..do I just go and replace it for him? Should I even use it at night? My daughter was obsessed with hers but I can’t remember when she was this little with the pacifier at night. Any tips would help! Thank you!