Office romance? I NEED ADVICE!

So I really like this guy a lot. We hang out all the time and are interested in the same stuff and we Snapchat each other every day. The only problem is that apart from all that, we work together as well. We don’t have your regular office job, we are carers so we can choose how much time we spend together. We’ve almost slept together a couple of times but I rejected him because we work together. I really want something to happen between us but I know if something does happen we can’t go back. We’ve known each other for 4 years and I’ve had a crush for 3 1/2 years. I can’t deal with it because it’s crushing me. Do I confront him or just leave it. What do I do?? xxx