Trust issues

So I've been in a relationship for almost 4 years now. it is a long distance relationship so yikes! But my partner had a friend that would always spend her money on him, buying gifts, they would spend time alone together and I always thought something was up. But I would take his word for it and move on with my day. The doubts were still there. So I get a message and it's his friend telling me that I shouldn't trust him, he's not loyal to me, all this crazy bs. I asked him what it was that the two of them really had going on and he said they were more than friends for awhile, that he told her about me and she wouldn't leave him alone. She would for like a week then start texting him again. It was like 2 years since I saw him and we finally met up like 3 months ago, he said even after spending time with me she was still in the picture and they even kissed. He's been begging me to stay with him, that it was the biggest mistake he's made and that he only kept her around to continue receiving those gifts. He said she was also talking to other people but she had serious feelings for him. It hurt me a lot hearing that. But I'm really not sure what I should do. It's been three 1/2 years and I'm not sure if I should leave or not. What would you guys do in this situation?