toxic In Laws

Marissa
So, my fiancé's parents are pretty crappy people. They're materialistic, literally pay their rent by selling pot, and just jerks. When they have a disagreement with their son they cut him out of their life completely. They're pretty toxic. I realize I'm not marrying them (and my fiancé is nothing like them as he was raised by his grandma) so I usually don't let their ridiculousness get to me but this last time they cut communication with my fiancé it was over $100 (that he never agreed to paying in the first place), and during this time of silence from them we got engaged. Since then he's tried to patch the relationship just because he doesn't want regrets down the line from them not being at our wedding, etc. since talking to them again they haven't congratulated us, offered to help with any wedding bills, planning or anything. They won't even commit to saying they'll be there. This pisses me off since my dad passed away, and would have loved to see me get married to a person that makes me happy and his parents have the nerve to just...not give a shit and prioritize a Hawaii trip over their only son getting married. . It leaves a bad taste in my mouth. 
My fiancé wants to see them next weekend and I don't know if I should go with. I suspect they dislike me (whatever, they don't have to like me, I'm confident in my relationship and know I make their son happy). If I don't go, I know I'm gonna wanna know how it went and my fiancé will just say it was fine or something. If I do go, I'm afraid they'll piss me off and idk if I'll be able to hold my tongue since I'm already annoyed with them over the noncommitment to the wedding. I think not going would make me look like I avoid them and I'm really trying to NOT have drama with the family in general but I don't want their suspected dislike of me to infringe on them fixing their relationship with their son so they can at least be on talking terms again.  What would you do? Go or not go?