Crying OFTEN at night for pacifier??

Ladies, I need HELP. Baby boy was doing pretty well sleeping at night. He outgrew his bassinet and now is in his crib in his room. Did pretty well the first night, but since then he pretty much cries any time the pacifier falls out. Granted, all I really have to do is pop it back in, but I'm getting up SO MANY TIMES. Oh, and I just went back to work, so I could REALLY use the sleep. Help??