Date nights create more stress...

I love my husband. He's an awesome man and father, but he just doesn't understand... it's already so difficult to pump at work to make sure I have enough milk for when I'm away at work, but my husband wants to go on date nights often, and I HATE pumping. I'd much rather breastfeed. It's so hard to leave my baby when I work. I don't want to leave him more for date nights. He's already grown up so much. I know date nights are important for our relationship, but sometimes it just creates more stress. Can anyone else relate?