Advice?

So, my best friend and I have been having sex for a while now and I've discovered I have feelings for him. I confessed my feelings for him the other night and he had told me he's not ready for a relationship. I told him I understand that completely and we went on with our friendship. Thing is I really want to be with him and only him, but the last thing I want to do is fuck up our friendship. What would you do?