Big supply drop after dropping night feeds ?!

So I used to feed my baby 1 to 2 times a overnight when he would wake up (he’s 9 months old) but I’ve recently cut back with the hope that he’ll sleep through the night. It’s been 3 or 4 nights of not feeding him overnight (8 pm til about 6 am) and today my supply is way down. I’ve only pumped 2 to 3 oz per session total when I normally pump 4 to 5 oz total. I just nursed him before bed and my breasts feel empty and he was still hungry after nursing so I had to give him an extra oz or 2 of pumped milk. The other issue is if he doesn’t nurse all night he drinks more milk during the day when I’m at work and obviously my pump output isn’t increasing to match. He’s been EBF to this point and I was hoping to continue until at least 1 year but I’m nervous about this supply drop. I’ve been trying to drink lots of water. What else can I do? Do I need to pump overnight?? Or maybe feed him overnight (he still has been waking up a few times a night but will generally go back down with a pacifier or diaper change).