Pets & baby--HELP!

An
I am currently 10 weeks pregnant and I have two cats. My family is freaking out because they don't want me around them at all while I'm pregnant. I know I'm not supposed to change out the litter so my husband helps me out and changes it for me. But I don't think it's a big deal right now, maybe when the baby is born. But has anyone had any bad experiences with your pets and your new baby??