He’s playing games and it’s bothering me

How can I stop It from bothering me? We’ve had this weird dynamic for awhile now. We are in the same friend circle. We have hooked up in the past and I’ve always been casual and whatever about It. But he randomly brings up that I’m to good for him, I’ve doesn’t deserve someone like me, I have my shit together. Basically he’s insecure I guess. He says he has feelings so he avoids me. We will run into each other and sometimes he’s cool calm and collective. Other times he’s cold. He makes It deeper than It needs to be but I want to stop trying to “figure him out” and take It for what It is. Do I just ignore him when we see each other or keep acting casual and let him go on his random tangents about why we won’t work?