Work Colleague Acting Off?

I started a new job about a month ago. There’s a guy who works with me and we’re the same age. I work with 4 others and he seems to talk to everyone except me. I’ve caught him glance at me a few times, had very little small talk.. but that’s it. If a group of us were chatting, he’d never make eye contact with me but he’d do it with the others. He just seems quiet around me. I don’t know if I’m reading too much into this but it makes me feel a bit uncomfortable knowing I have to face him.