Is it controlling to ask your SO where they are headed to as they leave the door?

Do you tell your SO where you are headed to as you leave out the door?

My husband has never had a problem with this until after his emotional affair. He says I’m controlling when I ask where he is going as he leaves ?

He even started just leaving without saying bye. I think it’s rude to not say bye. As I leave I always say something like “hey baby, I’m going to Walmart, be back soon”

This has never been an issue until now. I’m starting to wonder if I really am controlling. He says he is a man and can and will go wherever he wants and doesn’t have to tell me anything, he says I should never ask him where he is going.