reducing calories while breastfeeding.

I’m deeply ashamed to admit that my caloric intake is around 4000 a day! I’m wanting to get some of this weight off so I’m wondering if I cut back to around 3000 if that will affect my milk supply. I know breastfeeding moms typically only need around 2500 calories but I’ve also read that dropping a lot of calories can reduce your milk.