How to get him to like me

This coworker of mine and I have been flirting for a while. Hes asked me out 2 xs and I declined. Last week he asked me to go eat after work and I finally agreed. We started drinking and eventually had sex later that night. We agreed to not make things weird at work but for the first couple of days after it happened he was ignoring me. Then he finally told me he wanted to break it off cuz he thought I was telling people about us which I wasnt.

Then after he broke it off with me. He started flirting with me again.

I want to continue hooking up with him, but dont know how to communicate that to him..