Diaper change at night

Does anyone else hold off on the diaper change after/before nursing at night so baby doesn't wake up? My baby will sometimes sleep longer than a 3-4 hour stretch sometimes less and whenever he starts to wake from that I nurse him and he falls back asleep but if I do a diaper change before or after nursing him he'll be wide awake and I'll spend another hour or more trying to get him back to sleep.