Was I wrong?

So my husband and I are renting a place right now and his brother lives with us, (we make him help out on rent)

Since we are starting to look into buying a home I told my husband respectfully that I did not want his brother living with us anymore because he doesnt respect me, and my home. He expects to be handed everything to him and I'm done.

My husband got really upset with me and told me I was being mean. He said hes his only family here in the states so that i should be more considerate. I told him no, since he doesnt respect me he lost that chance, and it's not like we are totally abandoning him, obviously we'd make sure he has a ppl place to stay.

(Just a side note) his brother makes so much money he definitely find a place on his own)

My husband hit me with, "who will help me with the bills". I told him I can!!! I've been a stay at home mom but I can get a job and we can manage without him!! We honestly dont even need his brothers money

Conversation ended with him telling me I'm mean because I straight up told him I dont like his brother because he is so disrespectful.

Was I wrong to tell him that's how I feel????

I dont know what to do!