Going out with husband after having kids

Me and my husband have been together for 5 years. We have an almost 2 year old. Since our baby was born we have only gone out on a date ONCE and that was like over a year ago. So I brought up to him saying we should go to the movies / date and my mom can take care of our kid. He basically told me i was being selfish for wanting to go out and not taking our kid. Is he right?? I always read that its nice and healthy for couples to go on dates and I mean we are leaving our kid with my mom who I trust completely and my baby loves her so I know she will be ok but my husband was telling me I was being selfish and if i didnt feel bad going out without our kid….. We do go out a lot as a family and we always have a great time but I mean why not add a date atleast once every month? To just keep our relationship alive, healthy, fun…. do I make sense ?