gender reveal-rapist

Am I being insensitive for not wanting to go to my little sisters gender reveal party , when she invited the man that attempted to rape me KNOWING this man tried to rape me? I understand the guy is her boyfriends brother but I just feel like I shouldn't be the one getting yelled at for not wanting to go..