My boyfriend hates my family ! And it’s tearing us apart

So my bf and I have been dating for a year and 5 months and I am 17 ,my bf is 18 and we’ve always had issues of my family not letting me go out with him so much and too long through the day the most hours they’ve let me hang out with him the most is 5 hours and but when we first started dating I had just gotten out of a relationship a month ago and when I met my bf I thought he was the one for me and we got so lovey dovey and then he said he wanted to meet my family side note I live with my brother and his wife my parents are not in the picture and haven’t been since 4 years ago so they took care of me and back to what I was saying ... my bf wanted to meet my brother since my dad wasn’t there and my brother said it was too soon because he already knew the guy that I dated before and when he found out I started to date another guy a month later he got very upset so fast forward to today my brother still hasn’t wanted to talk to my bf and says “ he doesn’t want to get attached like he did with the other guy “ well that’s what my sister in law says but I think it’s bullshit and my bf and I have had the discussion plenty of times ... his family is very welcoming and everything to me but when he comes to my house it’s very awkward so I tend to stay away from my family because they put no effort into getting to know him and they said they would but it’s been over a year and now they want to get to know him but my bf has gotten tired of trying to talk to them because he doesn’t feel like they like him or that he’s not welcomed into our home and it made a us argue for a long time and I don’t want my brother coming in between us and tearing us apart idk what to do anymore because I want to be on my boyfriends side but I also need to be on my family’s even if I really hate them for saying things and my boyfriend didn’t want to talk to me for 4 days and I compromised too because I wanted him to calm down before he made a dumb decision and I also ended up surprising him when he came home from work because I knew he wanted to see me but didn’t want to say anything to me he’d regret because of my brother I still don’t know what to do