Husband has really bad memory loss.

Hey ladies...my husband has already been diagnosed with low t and recently switched to clomid from the gel to help with conceiving. He also has had depression on and off. He has recently had really bad memory loss over the past year. We are about to get him scheduled at a primary care physician, psychiatrist, psychologist, and endocrinologist to figure out what is going on with him. I love him dearly but I am about to lose my mind with his memory loss and have to remind myself to be patient....he doesn't have Alzheimer's or anything but seems to have selective memory...it is even affecting his job and can't do remember basic things! He has to go on leave for a little while until he is able to figure things out or he will get fired. We are both 30 and going into month 3 of trying...I know it seems like bad timing with his issues but we aren't getting any younger and hoping he will still have the time to resolve everything. Has anyone ever encountered really bad memory loss and if so, why and what helped???