My husband told me I should’ve never had kids

Long story short, we were arguing earlier about a bunch of different things. I was trying to express my feelings on how today (his day off) I really wanted to spend some quality time together as a family since we never get to do that because of his busy work schedule. He took it as if I didn’t want him to go work outside on the house, I told him it wasn’t that like that, I start crying and vent to him about how I’ve been stressing about being a SAHM, how I feel lonely and really just need some adult interaction. He’s mad at this point and so he tells me “You should’ve never had kids if you knew you would be stressed” I start bawling even harder and he really just doesn’t understand. I left the house with the kids and I am at in indoor playground now. Am I overreacting for being upset about what he said? He told me he wanted to come with me but I said I didn’t want to be with him right now.