Girl messing with my boyfriend.😒

Desteny
What do I do? there's a girl that's my boyfriends ex. She's telling everyone how she's so in love with him and how she's going to get him to cheat on me to get him back. she flirts with him right in front of my face. I've told him how much it bothers me, but he can't avoid her because he has several classes with her and they go to church together. she knows I don't like her but she continues to flirt with him. Him and I are really happy, but I'm really tired of her. What do I do without telling her off? I really hate confrontation. please help.