Baby is weaning off breastmilk, how do I avoid mastitis?

My ten month old usually breastfeeds 4-6 times a day. She’s now having two bottles of formula a day as we slowly reduce the feeds of breastmilk and wean her off it altogether. So I’ve dropped a couple of feeds with breastmilk and my boobs are obviously getting very engorged and painful with all the milk that would normally be drunk. I don’t know what I should be doing about this. I’ve read to let it happen and put up with the discomfort and all the leaking for a week or so and my body will realise it’s not being drunk and stop producing so much, but then I feel like that’s going to end up with me coming down with mastitis, right? and obviously I don’t want that. So any tips on how to reduce my milk supply whilst also avoiding mastitis would be muchly appreciated! (: