Am I wrong?

he's been trying to find work for months. I know that he is trying but he has not found anything and he the reason he lost his job was not his fault. This has taken a huge toll on me, I'm super concerned that we are going to have to move, or lose our house. I barely talk to him and I'm definitely not interested in sex, he says that it must be because I dont really love him and only cared for him when he was making money, but I cant just act like we sre doing fine! Am I wrong for this? Has anyone been in a similar situation? TIA