Ex /friend conflict advice

I thought that I was deeply in love with him and he was the guy I lost my v- card to. We were best friends but he always made excuses why I wasn't ready to date and why he couldn't spend a lot of time with me. We are both stubborn but now we wana be friends and figure out our friendship/ relationship. I dont know if I feel the same way about him since he dosnt make very much time for me and some of the things he has done. He's a freshman in college and I'm close to graduating high school. He tells me I need to experience things in life that dosnt have him in it so I understand more... The thing is, is that we have sex every so often and i dont know if we should or we shouldn't? And how should I feel about being friends while knowing he's sleeping around? Any Advice?