How to healthily be there for him...and me

My husband has some very toxic people in his family, he cannot cut them off and he is very attached to one of them but the whole lot is so poisoning that is getting to me as well. I always supported my husband and always felt like his problems were mine but this is becoming very intense and I need to take some distance from it all. These people don’t live with us but have regular contact with my husband. I still want to be there for him, don’t get me wrong, but in a more healthy way for myself. Would I be a bitch if I tell him that I am here to listen to how he feels but I don’t want to be made aware of the specific things that these people say or write to him? I don’t want to know about their spite. I still want him to freely express how this makes him feel but I don’t want to have to listen or read their conversations, they make me sick. I would also want to ask him to limit the freedom of action these people have so that it doesn’t affect our plans, time together or doesn’t make us loose opportunities simply because these people must have him under their thumb at all time...we don’t financially depend on them, it’s just a matter of family. And last but not least I would like him to have much more consideration for my expectations rather than hear them and then force me always to reshape them in order to meet these people need for control/ impositions. I have expectations or needs of my own for me and my family and if these people try to jeopardize them, I would like him to be able to prioritize them and let something go rather than always ask me to adapt. He is reluctant to let go on anything as he feels that he is giving up on his family and that is something he will never do. If instead he wants to carry on living under their dictatorship, then I want to be free to at least do things for me and my daughter and if someone has to miss out it will be him, not our entire family.

Sorry for the lack of details but I rather ask without disclosing too much information on the issues. Also because what I worry about is if my change of approach makes sense or am I being a bitch towards my husband? Any other advise from people who lived a similar situation where you had to be there for someone with a very toxic baggage, is highly appreciated.