I need so advice here

Alright so I’ve been with my boyfriend for 2 years and 2 months now and I love him.

Ok. So today at work (I’m a CNA) I’m clocking in at 6am I go over to get report from night shift so I can start my shift. One of the aides is a tall male. Keep in mind I hardly talk to him only on shift change. Well today he complimented me and I just said thank you and walked off. I’m working and working and close to my shift being over he comes back and gives me a piece of paper and I’m like what’s that? He simply responds it’s a piece of paper so I just looked at him like oh well I’m busy but he then stopped me and told me it was his number and I didn’t wanna be rude so I took it and just said thanks and Walked off. He then found me again to tell me he was sorry it was disrespectful but i paid him no mind and said it’s okay. Now I have no intention of texting him but I know I’ll see him again sometime soon at work. I want to tell him in person but how do I start? I don’t wanna text him because then it’ll be like an invitation into him texting me daily. What do I do ladies?