Would a face scrub work with sugar and honey?

I wanted to make a diy face scrub but I'm not sure what to use. I don't have any fancy oils except olive oil. I have some honey and sugar and i was wondering if it'll be a good enough face scrub? If not do you ladies have any suggestions