Help me out!

Ok so I don’t let ANYONE get attitude with me except for my mum because duh. But my boyfriend gets loud with me sometimes when we aren’t arguing and I tell him to tone it down but he just gets louder. So I catch an attitude and then he gets upset. I move away from him but he just follows me and then says sorry over and over. This happens all the time! What do I do?

Also he doesn’t feel loved and isn’t treated like it by his family and it seriously seems like I’m the only one who cares about him. He has depression but idk what to do when he brings them up. I can’t even go over to his house anymore because whenever we are in his room, his brother and sister yell at us and kick the door open. Idk what to do