Rules of TTC with heavy labor job

I have 2 sons my oldest being 7 and yungest is 5 so this isn't my fist radio. But my fist time TTC and having a job. A very physical job, for example I pick up 40lb that's not bad I know.. but I do it pretty much threw the whole day as the weight fluctuates more up than down. my husband and I are trying to have a girl.. and I just didn't know if putting that much activity on my body would effect any of that?