Mom guilt is so real right now

My baby is straight up addicted to her bottle. I’ve had such a hard time breaking her of it and now she’s 2. She drinks milk every night at bed time and sometimes falls asleep drinking her bottle so I don’t get to brush her teeth. I’m pretty sure she has a big cavity and I’m just really upset with myself for not breaking her of this habit. It’s been rough while separating from her dad and transitioning into being a single mom, so I’ve been letting this comfort her.

She already had to get 2 teeth pulled when she was very little because they didn’t develop correctly and now this. I was venting to her dad about it and telling him how guilty I felt and I started crying and he goes “oh my god are you crying? If you wanna blame yourself, blame yourself then” and it just made me feel worse.

What can I do to fix this? Obviously no milk anymore after brushing her teeth and start taking away the bottle… but will the guilt go away?