Be honest ladies. I'm I wrong ?

So I have a 3 month old. My husbands brother recently moved in with us from Texas because he was doing really bad not working, drinking, smoking, bad relationships and laziness. So I told my husband from day one ok we can help him get back in his feet as long as he works, helps me around the house and stops being lazy. Ok both agreed. Ever since he got a job he doesn't clean his room or helps me around the house unless I go in there and get him which I don't feel comfortable with because he's an adult and I don't just want to walk in there. So today I exploded and told my husband in front of him I didn't sign up to baby sit him he needs to man up and he responsible. Yes I sounded like a bitch but I m just not going to sit here and not say anything. My husband is usually at work all the time. He told me don't ever say something like that again no one told you to open your legs and have a kid, he needs sleep, he works so I said not 24 hours of sleep straight I work nights too and I don't sleep no more than 4 hours. Again you have a baby he doesn't so then he said if you say something like that again pack your shit and leave. My 3 month old it's also my husbands. Do I deserve this I believe I do but I'm not sure.