One more rude question... 😡

Today I've been asked for about the 5th time in as many days if I'm working out. WHY on earth do people ask this?! 
I am NOT working out and whenever I'm asked I feel like I have to defend myself. I'm exhausted and having round ligament, hip and back pain at 27 weeks. I try to go for walks when I feel up to it but I am certainly not "working out." 
I don't see how this is an appropriate question to ask. I'm fairly active in general but am nowhere close to anything like a gym rat or an exercise enthusiast where it might be a natural question about whether I'm keeping to my routine. So why ask? Why make me explain myself and feel like I'm failing to keep in shape when it's all I can do just to work and drive my commute every day?