Just have to vent

I work with the public, they do not know me and I don't know them. I had a husband say to me "you just made my pregnant wife's day". I know he didn't mean it this way, but it really felt like a slap in the face. I really wanted to say, oh congratulations, I've been trying to get pregnant for x number of years, but I decided not to. I understand that maybe they were excited and maybe they struggled as well. But I really didn't need to know she's pregnant.