Mom shamed for drinking coffee

So I was walking down the street with a small decaf coffee when some woman pulled up beside me and told me how much of a horrible mother I was for drinking coffee while pregnant. I proceeded to tell her to mind her own business and walked away while she continued to yell. I’m just curious as to how many pregnant mamas have a daily cup of coffee? I usually have only ONE very small cup of regular coffee in the morning but if I order from a coffee shop I’ll get decaf. I didn’t drink coffee at all up until 22 weeks because that is when my nausea went away. I did not ask my doctor if it was ok to begin drinking coffee again. I figured a small cup a day would be fine, but now after that incident, I am questioning whether or not I am doing something wrong.. 😓