Body Fat and TTC

Jennifer
My husband just got home from deployment and we are going to start trying. My dr told me recently that he thinks I need to back off my working out and gain some weight bc he doesn't think I have enough body fat. Could this be possible? Has this happened to anyone?