I’m worried our strained family relationship will affect my baby

So my husband and I have had trouble with his family ever since we got married. They have a very cultish dynamic. They all live within eyesight of eachother on their dad’s land, And expected us to move there also. However, we both saw their toxic tendencies. I grew up in a very similar dynamic so I can spot it from a mile away. His dad is the type of man to hold things over everybody’s head, and they have to ask his permission to do anything because they all live on his land. My husband and I didn’t want that life for us or our children, so when my grandpa offered us 25 acres for $25,000 we jumped on the opportunity. His family got very mad because this land is up the road from my family, rather than theirs. We would not have moved here had my grandpa not offered to sell the land, But since the deed would be ours we took it.

Of course I got the blame for this, even though my husband lived an hour away from them before we even met. His sister was very jealous and his brother was extremely petty towards me. Dad was OK for a while, but that all changed when we had our baby.

And I ended up having pre-eclampsia and had my baby on October 31 of 2021. We were so happy. His family was very ugly to him while I was in the hospital following our babies birth. His sister and sister-in-law kept wanting to come to our house and take over the baby and I didn’t allow it because they have been so ugly in the past. They also have four boys between the two of them and they always stay sick, so I didn’t feel comfortable with them being around my newborn. My mom was right up the road and she’s the only one I trust other than my husband to help with the baby, so if I needed anything I would contact her. Fast forward, I am home and we invite family over in small intervals. Including his. The first visit seemed pretty good with everyone, but in late November we were invited to his brother’s house to eat, and everyone else was going to be there. We walked in, and his dad had been drinking and was already on a tangent you could tell. I sat down my car seat since the baby was in it and he made a comment about my car seat cover. We thought he was joking so my husband started joking back with him, and out of the blue He erupted and threw a fit about how he couldn’t joke with anyone or how we took Everything personally. He stormed out and my husband hasn’t spoke to him since.

He believes also that boys are superior to girls, and of course we have the first girl amongst his grandchildren. At Christmas time My husband, baby, and I, had Covid. He never called and bothered to check on his granddaughter. I took it very personal, and I worry that this is a glimpse into the future and that she will feel like she is not good enough for his love. My husband wants to be close with everybody and fix this problem, but I just don’t know if it will happen. I truly don’t know if I even want to after he chose to put his petty selfishness over his granddaughter this Christmas and not bother checking on her. It has been such a roller coaster with his family, and I haven’t even touched the surface of the stuff that has gone on with all of them the past year. What would you guys do?