Love triangle

So I've been with the same guy for over 3 years, got pregnant right off the bat and we now have a second child together. Aside from the two, he has two other kids I'm now a step parent to. Anyway, so for months now I keep thinking of one of my exes and I feel like I've ruined all chances with him. Should I message him and try to see if we ever have a chance again despite me having kids with someone else, or stay with the guy I'm with now because we have a family? I love him but I'm not happy, this isn't the life I wanted. And I cannot stand his other kids, they're completely disrespectful and I don't want to raise them. Please no bashing I know I got myself into this.