How would you react?

My fiancé and I have been together for about 3 years. I met him when he was living near my hometown and in the Army. He got out of the army about a year into our relationship and I moved with him and his son to Arizona. That is where he is originally from. When we got there things really just didn’t work out. It was hard for me to get jobs with the degree I have. His family where straight up rude most of the time ect. His family really didn’t like me or his kid (his son is transgender they couldn’t handle it) and would make rude remarks about us all the time. This paired with the fact he realized he didn’t like it made us decide to move back to New York where I from. We decided when we moved back here that we would stay with my parents for a little while. We are saving to buy a house and only plan on living here for a few months. They have the extra room so that part is really no big deal. The big deal comes along with my brother. Who my fiancé is friends with. A few years ago he made the terrible decision to get with a girl who was into drugs and ended up getting into them himself. He now realizes this and is working at getting his life straight. He’s getting off the drugs. Going to programs for it. He’s recently gotten a full time job ect. His girlfriend on the other hand hasn’t really come along this far yet. She’s working on getting off of everything and getting her life clean. Just a lot slower. So this is causing issues in their relationship. So they have been fighting a lot. Now this is where the issue comes along. My fiancé keeps telling me that he doesn’t need this. That his kid doesn’t need this. All the time whenever anything happens. He was the one who wanted to move here though. I didn’t want to. I said it wasn’t the best idea but he was all for it. Every time he says I don’t need this or my kid doesn’t need this (his son is 17 and says it doesn’t bother him at all) I feel like I’ve dragged him into it all or guilty. But then I get annoyed and mad because I’ve dealt with so much drama for him. His ex wife was complete drama for us for the first half of the relationship. Then I put up with his family for a year without issue even though they were rude to me and his kid (which bugged the crap out of me cause he’s the sweetest kid and I would do anything for him.) any ways I’m sorry this was so long but how would you handle this. I want to bring it up to him that it brothers me when he says it but I’m not sure if I’m just over reacting and should just let it go.