Pacifier nursing, help!

My 5 month old still uses me as a pacifier (and I can’t replace my nipple with a binky because she’s never taken one). What can I do? What did you do?

It’s pretty much only when she is sleeping. I still nurse her to sleep and eventually I can get my nipple out of her mouth without waking her but most of the time she moves right back onto it. Especially when transitioning to next sleep cycle. We also bed-share and some nights she is attached to me for what feels like all night. Did you have to “sleep train”? Or do some babies just grow out of nursing to sleep and pacifier-mommy? I don’t really want to let her cry herself to sleep. (I also love sleeping with her at night, but understand that it can’t last forever and she needs to sleep on her own). But contact naps take up a lot of my time. I want her to be able to fall asleep without boob and stay asleep without me.