Hurt Need Advice

I was raped by my cousin when I was 7 years old. Only my bf and my therapist are the only people that know. The same cousin came to visit us on Thanksgiving and it was nerve racking but I survived. I was telling my bf how it went with my cousin there and he said who knows if he even remembers raping me. Do I have a right to be upset? He claims to have said it to bad mouth my cousin by trying to say my cousin is such an asshole he doesn't even remember my rape but..... But in the same breathe he's telling me to confront him. Why would I even want to when he already put the idea in my head that he might not remember. It would just make me feel even more insignificant that he did that and didn't even remember. On top of that I don't feel like he supported me enough through this. He asked how I felt about it a few time and told me he was there for me but didn't want to talk about it unless I brought it up first. I truly believe that he def could have brought it up more and checked in just to make sure I was okay and had a game plan for when my cousin came.