Working out while TTC

So me and my husband are both slightly overweight and unhappy with our discomfort of the extra weight. But we are TTC and have been for six months now. My question to everyone is:

Is now a bad time to start working out if we are TTC? Could it hurt the baby if I get pregnant and was working out when my body normal isn’t used to that??