'Who's home with baby' question

Hi Glow family!

I went back to work when my baby girl was 3 months old. She's 6 months now. My husband is a stay at home dad which is great for us as I was earning more money. I work in retail and happen to have a male colleague who has a 7-month-old baby which is great because we don't annoy our other workmates with all the baby talk :)

The only thing that's starting to annoy me is that I almost ALWAYS get asked by customers/brand reps/anyone "Who's home with your baby" when they find out I have a baby at home. My male colleague literally never gets asked. I know it's just a small thing but the feminist side of me gets irked each time it happens.

Just wondering if anyone has a good way I can respond to this that gets the point across that women aren't the only capable caregivers but doesn't sound like a crazy person lol

Also am I the only working mom that gets annoyed by this?