IS MY SELF ESTEEM RUINING MY RELATIONSHIP 😫

So I struggle with really low self esteem with my looks and just who I am, it makes me feel like I'm not good enough for my boyfriend, I constantly think he should should be with someone else, I feel bad that he's with me (all of which I've told him) he always tells me otherwise lol. I've broken up with him a few times because of it.. And then we got back together each time. It's not fair to him that I do that and I know that. But is this a toxic trait that could or is ruining my relationship with him?