Sex-Friend

So I have my best friend, he is a total player but as a friend he was really good to me, and one night we made a terrible mistake and ended up sleeping together,after that he told me we should give it a try as a couple, but I knew him and he wasn't going to change for me, so I told him we were better off as friends and he agreed. our relationship as friends changed completely because he wasn't telling me the things he did with other girls as he used to and it was like we were total strangers and one night trying to fix that we went out and hooked up again, I know I don't have feelings for him because I know how he truly is but this attraction is killing me, and I don't know what to do because I can't go sleeping around with him every time he wants ...