All night nipples

My babe starts the night in his crib no problems. Somewhere around 2-3 he’ll wake up and I pull him into my bed, in his room. (Daddy sleeps downstairs in the king size all by himself) Anyway, baby spends the rest of the night in bed with me. He used to dreamfeed and fall back asleep. Occasionally snacking a couple of times through the rest of the night. But lately he’s been wanting my nipple in his mouth all night long. Literally. He will fall asleep and lose his suction, flail about until he finds his way back, relatch, suck, fall off and repeat. I’ve tried slipping a binky in there instead but he’s no fool. Idk what to do but I feel like we are creating a really bad habit by continuing the all night nipple. I’ve been hoping to transition him off of night feeds all together around six months, I’d like to return to the big bed downstairs. Seems he has the opposite plan.