My brother irritates me

My brother irritates me every day when I see him doing nothing. He can’t keep a job and he is 43. He is not working since thanksgiving now. I told my husband to give him an ultimatum and go rent somewhere else. But he is a good man and told me that he will do that but he is waiting a little longer to tell him that. My two big brothers want to live with their sisters (me, and two more to save money) we are younger than they but they couldn’t make a family because they’re shy, I know that’s not an excuse but what to do? My brother that lives with me has autism but he doesn’t want to go check it out because he said that he acts normal. But to me and my other siblings he doesn’t. He does repetitive things like closing and open door like every minute and wash his hands with all the soap every 30 minutes or when he touch something. He doesn’t want to take care of himself like putting cream on him because his skin looks irritated for the soap. He doesn’t have any friends because he thinks everyone is bad so he only talk to us (sisters) I’ve talked to him nicely to be more open and go look for a job and when he gets a job he says all men there are annoying and talk bad to him. I don’t know what to do anymore