rape?

If you didn't say no to having sex but also didn't say yes is it rape?? I was really little and I didn't think that anyone would believe it so I just let it happen. The guy who did it was 6 years or more older than be and I was about 5.