Selfish or controlling?

My SO has always said that me (a SAHM) wanting to leave the house & do things with friends is selfish. I should put the passion that I have to go out with friends into my kids. We spend 24/7 in the house. I don’t think me wanting to go out with friends or even bring my kids with me is selfish at all. No one wants to spend 24/7 in a freaking house. I went to a baby shower today & I’m basically a piece of crap because I should be at home spending time with my kids & wanting to teach them things. As he says basically. My kids are 3 & 1. My 3 year old could do almost everything by 2 like sing his ABC’s, count to 15, his colors, some of his shapes, and MUCH more because of ME! So what do you guys think? Am I being selfish or is he trying to be controlling?