I keep thinking I see my attacker

Whenever I'm walking around my campus I could swear I see my rapist and my heart starts to race with fear, then I do a double take and realize it's not him and I feel so relieved. This is mainly because I had him banned from my campus. Part of me is scared to death of seeing him again, hence why I'm always paranoid that I see him walking around. The other half almost wants him to come on campus one more time, so I can call the police and have him arrested so he can get what he deserves. I hate being plagued by these thoughts and fears, any advice?