Am I wrong for not wanting my parents to change my children's diapers?

So here's a little back story. When I turned 16 my parents admitted to me that I had been raped by someone in the family when I was a young girl, but they refused to tell me who to "avoid conflict". Since I am 21 now and having children of my own, I am afraid of leaving them in the care of my parents alone. Not only because they were so comfortable keeping this massive secret from me, but because they want to avoid conflict with by confronting my rapist, whomever that may be. I am afraid that they will allow my child to be around this rapist and say nothing if something happens. Now, I'm afraid that I have let my kids around them under my supervision, but both of my parents have gone off in other rooms to change my youngest. I don't know if either one of my parents was the rapist they are talking about. I have since stopped allowing them to change the diapers because of this. And they are so royally pissed off at me. I feel bad because I don't want to think it is them, but since they refuse to tell me I have no idea what to think. Am I wrong??