How do you know when to say it’s over?

So I’m having a little bit of an issue. My boyfriend just told me i don’t appreciate him or anything but I truly do. I do so much for him and I appreciate everything he does for me. But it gets to the point where he says “you don’t care” or “you don’t love me”. And it’s seriously upsetting me and making me think this relationship. How do you know when to say it’s over?