TTC and Cleaning Litterboxes

St

I have been TTC for a few months now. I have 2 cats at home in which my husband and I split the chore of scooping their litterboxes. I also volunteer at a cat rescue and clean boxes and cages once every 2 weeks. I have heard that you shouldn't do this while pregnant. Is that true? Same for TTC? I do plan to have my husband start cleaning them at home. I really don't want to quit my volunteer work but if I have to temporarily, I will. Thoughts?