Tempted to get one full nights rest

So, I am lucky to have a baby who goes to bed at 8pm and wakes up at 7am. I power pump after she goes to bed and don't get to sleep myself until 10.  Then I get up at 2 to pump for half an hour, but with setup and take down its more like an hour. Then I get 2.5 hours of sleep to be up by 5:30 and out the door by 6:15. All said, I get about 6.5 hours and that's even pumping on my drive in. It's rediculous when my baby gets 11. I'm tempted on Friday to skip my middle of the night pump just once do get a solid night of sleep. I feel awful. But how much will it set me back? I just barely pump enough, and it was hard work to get here.