Do I give up

I've been in love with my sons dad for several years but my son is nine now and we separated when he was two he married another girl I married another guy and now we both going through a divorce at the same time not because we cheat with each other but because  we both believe we're soulmates but he's so angry now and it's like we're together and we the most happiest people and when we separate were arguing I love him and can't imagine the rest of my life with out him  but I can't take the anger do I leave or do I stay