Getting rid of paci

This sounds selfish, but the reason why I don't want to ween my son from his paci is because I'M not ready. He is 27 months old and I feel like it is one of two things that makes him my "baby" still. (The other being his crib). Help me get over this hurdle! Should I just go for it and get over mysel? Should I let him keep it longer?

Update: He only uses it during nap and bedtime...