Trust Issues

Where to begin... Last night me and my husband got into it bad after I checked his phone. I know it's wrong and I should trust him but the problem is he has been so distant and cold. For the past 2 weeks he has been rejecting me so much and I just couldnt hold myself back. Point is I found a couple of messages and voice messages where he was talking to another woman and they agreed to lie to me in case I found her phone number in his contacts. They agreed that he would tell me she is his cousin. He is from another country so I really dont know his entire family. They werw obviously talking to each other and video chatting and some messages were deleted... I confronted him and he obviously found the perfect excuse that he agreed to lie because im such a jealous person. I dont understand why because I really try not being jealous at all. He said he just cant trust me no more that I betrayed him because he trusted me with his phone. He confessed that she is his ex girlfriend. I understand that he feels upset but who should be more upset? We have a 2 year old daughter and he left me half way through my pregnancy because another woman lied about her having a child of his (which wasnt) and he came back after a week than later left me again when he felt I wasnt being woman enough at home with chores... any advice?