I fucked up.. again..

My boyfriend of 2 years is asking me to stop hanging out with my father and grandmother.

He’s been through many situations with them, and in my opinion has been embarrassed and mistreated. My family is evasive and controlling, and very quick tempered. Anyways, every time I hang out with them, he gets hurt because they treated him so badly, me hanging out with them shows I don’t care and I don’t stick up for him.

Time and time we argue about it, and I see where he’s coming from but with the pressure of not wanting to abandon family or be rude to them... what do you think? I’m in the dog house currently, my man is very upset... says my apology Doesn’t mean anything.