Complaining husband right?

My husband is an anxious person and we’ve been married for 2 years and together for 7yrs. We have 3 kids under 4. A while back my parents and brother were over for dinner and husband complained about how it’s a pain to have a family and told my brother to stay single. I got really annoyed and embarrassed. I said to him, this is the life he chose and he finds it so awful maybe he should divorce!!! Yes, it was wrong of me to say divorce. He said, “man, can’t I express how I feel at the moment without being nailed to a cross”

And today we were at a family gathering and he says in the room, how he’s dad and his brother have a good life and not dealing with all these kids!

This is not only offensive but I feel like he’s taking us for granted. When we dated, we wanted the same things, he even said he wanted 3 kids. When things are good he says he is happy and has everything he ever wanted and when he’s overwhelmed he just backtracks.

Am I overreacting, would this piss you off and say something? I don’t want it to make it sound like I’m forbidding him to express himself but at least he should filter what he says, or no?