Keeping hubby happy

Start out with some background - my husband and I have been together for 9 years, married for 2.5. We have an 18 month old and a 3 week old.

My husband has been pushing me recently to go out soon. I told him once the baby is a little bit older that we can go out for a while. Well we have a surprise party to go to in 3 weeks (baby will be 6 weeks old) and made plans for my mom to watch the girls. Well now he tells me today that he wants to make a day of it and leave around noon vs. just going at night for the party. I told him absolutely not because I don’t want to leave the baby for that long. He then broke down and told me that since we had our first child i don’t want to spend time just the two of us which for the most part is true and that he’s going through some depression because he feels neglected. I work full time and he stays home with the kids. When I am home I want to spend time with them. We used to go out do so much together but I just kind of thought that having young kids you sacrifice that for a few years. We’ve been together for a long time but marriage wise I’ve either been pregnant or nursing for pretty much the entire time.

How do I give him attention without feeling like I’m neglecting my babies.