Sleep Training Help

My little guy (6.5 months old) needs his paci and some back patting in order to fall asleep. It's all good at bed time, but he also wakes up 3-5 times per night because he loses his paci. What can I do? I really don't want to go get him his paci every time.. (side note he also wakes up once a night for a feeding). Any advice?!