after 5 years...we still find a way back.

so I dated this guy when I was 15, not going to lie, it was a pretty toxic relationship. I was 15 and he was 17 almost 18, he was pretty controlling and just too much to handle. we broke up after a year together and I'm 20 now. Hes 22. Throughout these 5 years, I've seen him on multiple occasions and wr even talked here and there. We just always end up in each others way somehow. would you take that as a sign? I believe in signs and I feel like hes going to be an important part of my life in the future...whether it's good or bad idk. when we talk, he always tells me he misses me and deep down, I miss him sometimes too. but I'm scared of getting back together because of how he was years ago. opinions?