Memory Issues?

How do you know when it’s time to see someone about your memory? I’m constantly forgetting things. And it’s getting so much worse. I’m forgetting whole conversations that I just had. Forgetting peoples names right after they said it. I forget what I’m supposed to do when I go to do them. I forget everything constantly. And now it’s affecting my work. And I even forgot to tell the babysitter to pick up my daughter because her after school program was cancelled. It’s frustrating. I’m not on any medication. I’ve never done any drugs. I don’t drink alcohol ever. And yet I find myself having to leave myself notes about everything g because I know I’ll forget. I hate this. At first my husband thought it was funny but now it’s worse and trust me no ones laughing. I had two concussions in the past and suffer from migraines but after many many neurological exams...they found nothing to pin point the migraines. Could it be related? What do I do?