Cat Litter Issue

M
So my husband and I have two dogs and a cat, but we talked about him having to clean the litter box during a pregnancy several times and he agreed to it. Now that I'm pregnant, he has been cleaning the litter box for eight weeks or so. He told me last night he won't clean it anymore and that we need to get rid of the cat. I'm totally frustrated!! I take care of both of his dogs (walks, bathroom breaks, washing, feeding, etc.) all day every day. I'm currently house breaking the puppy, so I clean up my fair share of poop and pee. He says it is unfair and gross to clean the litter box. Getting rid of the cat is not an option. Any advice? Anyone having a similar issue? Thanks!