Breast pumping exclusively

My son is starting to sleep through the night, my pumping schedule is usually 12, 3, 6, 9 repeat... I've already cut my midnight(12am) out because he is usually sleep, now he's starting to sleep through the 3am one also should I cut that session too or keep doing it and just freeze the milk??? I know many may say keep doing it but I'd much rather sleep lol but I also don't know if I cut that one too will it throw my supply off for the rest of my sessions???