How do I get my baby to stay asleep at night without her wanting to nurse for comfort?

Let me explain...Okay so my daughter is 11 months old and I am almost 6 months pregnant. I started supplementing with formula when she was 9 months because my pregnancy caused a significant decrease in my milk supply and now it seems like I almost don’t have enough milk for her so she’s been drinking formula and eating solids mostly BUT she still nurses throughout the day but it’s mostly for comfort...I only hear her about 1-2 times, sometimes 3 times a day actually getting milk from me because I hear her swallowing but all the other times she just sucks for comfort (mostly when she wants to nap or when she’s overstimulated). (She is high needs and extra emotional) Before my milk supply dropped she refused a bottle but now that my supply dropped she took the bottle almost without a problem. The day time nursing for comfort is fine with me but now that I am getting closer to having another baby, I need help finding a way to get her to stay asleep without nursing for comfort. The reason I say this is because at night she will wake up several times just to nurse for comfort. My nipple would literally just be sitting in her mouth and she won’t even suck passed one minute but as soon as I remove it from her mouth she wakes up and cries. She’s never liked pacifiers either so that won’t work. I just know I will be up with the new baby nursing her a lot at night and I don’t know how that will work if my daughter wants to sleep with my nipple in her mouth. Any advice would be very much app. Thank you.