young love problems

Ok so I just moved to this new state and a lot has changed about me. Except my love for my ex who also moved. We've always been cool even after breaking up but we didn't really talk too much. Makes sense right? Anyway we moved and a couple weeks ago some other dude asked me out. No interest in him what so ever but I can't avoid him, he goes to my church, and he keeps tryna flirt with me and touch me. And then there's another guy who I think is kinda cute and kinda cool but I'm not too into him. Like 2 days ago my ex hits me up and then calls me at like 1:30 am. We start going back and forth and it sounds like he's trying to come see me but idk. What do I do about all this stuff? Should I even be doing anything? Like is this even a real problem?