Future family in law issues

I’m torn and dont know what to do. My boyfriends family is difficult. Especially one of his brothers and his girlfriend. We’ve had our issues. Point blank they make it hard and have made the rest of the family not care for me as well. Everyone is obsessed with his brothers girlfriend tho (I can’t figure our why to be honest) but it’s her world and all of them just live in it for some reason..so of course I’d be lying if I said I’m not jealous, because I wish they’d be welcoming to me too. When we found out we were expecting (which ended in an ectopic) his brother went as far as asking him if he was sure it was his, which was ridiculous. Had anyone asked that to him and his girlfriend (they were pregnant weeks after they met each other and started dating) there would have been a huge problem. When we lost the pregnancy not one of them except my bf’s sister reached out to us to ask us if we were ok or anything of the sort. They also go as far as excluding us from things, they tag each other in things all over social media and like each other’s stuff, always interacting, but never when it has anything to do with my boyfriend and I. I know that seems petty to be upset about social media but it’s really the bigger picture. There was one huge fight around Xmas which his brothers girlfriend instigated completely and ever since then my boyfriend and I basically live in our own little world without them although we have been around them for family functions since then it’s still awkward and uncomfortable. My boyfriend has stood up for me and for us without going too far but I’ve never done anything to these people but try to get to know them and be part of their family and it just doesn’t get me anywhere. I love my boyfriend more than anything and don’t want this to be the cause of us ending, but the more and more I think about it the more it bothers me. He says to continue to give it time and they’ll get over it and come around, but I don’t agree. It makes me not excited for things like getting pregnant again, or for whenever we get engaged or married...things like that. What do I do?