SO or cat

I feel like I'm caught between a rock and a hard place I love them both so much and obviously it's two different kinds of love my SO doesn't like the cat we have recently got a new sofa and carpet in the living room. He is giving me an ultimatum him or the cat I don't know what to do as we have a baby and I know I will struggle financially without him around..I feel hurt that he is making me chose so torn by thought of it I just don't know what to do

Advice please