Baby brain comments

Has anyone else gotten baby brain or pregnancy brain comments and been annoyed? I've gotten them a few times and when it has nothing to do with "baby brain" it's more to do with having alot on my plate at home and at work. Unless I say I'm having baby brain I don't feel anyone else should be. Its kind of insulting like my brain is handicapped while pregnant.