Do i end things

My boyfriend called insulted me, and said i had a paranoid mind when i stated that i sacrifice a lot more in relationships and he tells me who im allowed to cut off and i asked him why he couldnt do the same for people who he actually keeps secrets from me to and who actually influenced him to break up once and talked s*** behind my back. This has been going on for so long, in fact he still talks to them and hangs out with them, yet i cant do the same. Its so unfair and it stresses me out every single day. Should i end things?