Decreased libido and new pet ownership is irritating my husband

After I got my iud in February, I've not had much craving for daily sex anymore.my husband feels good after sex, but I don't feel any different. We just adopted cats two weeks ago and he keeps threatening that if they stop us from sex, he wants to return the cats. He just tried to start sex on the couch, but I don't want couch sex anymore because I'm worried about cat hair getting into my vagina... how do I fix this? I love him so much and I'm scared that we will have to return the cats when really they're my escape from not wanting sex. And he refused to go to a couples counselor. I don't know what to do .. advice on any part of this would be appreciated.