Cat smell

I know when yours pregnant your not suppose to do the litter box.. But what if the house smells like cat pee and poop. Is the pee smell harmful just to be breathing it.