Husband talking to ex and deleting chats

I never thought in my life that i would ask a community for advice in relationship.

We have been married for 4 years. He loves me, cares for me and everything. But he has secrets, one of his biggest is his ex. Right after marriage i told him openly about my past an we decided to never bring past into our relationship.

2.5 yrs into relationship, dealing with 2 miscarriages i got mad that he is always on ph and deleting history of chat and calls. Turns out my husband is talking to his ex for an yr and helping her with divorce. Had a big fight, tears, crying, sobbing for days. He promised will never talk to her again.

Today 35 weeks with our precious child, getting preterm contractions and praying every single min to make to full term. Came out of room in midnight to find him closing his ph and trying to act normal. When i took ph, he started panicking and arguing dont look into it for baby. Yes, he is texting her again. Admitted it but deleted messages. Now he says he made a mistake and not stress out now for baby’s and my health. Says i am his priority and cant loose us and forgive him one last time for life. Asks to forgive him and discuss this after baby is born.

I couldnt stop crying. I dont want to hurt my child with my stress, but what can i do? I dont want to loose him either but at the same time i cant be with someone who isnt loyal to me. I cant tell my family or friends about all these. Am clueless, please suggest what to do.

Update: He still keeps saying me an baby are priority and he spoke with her out of guilt. Asking me to eat and drink for baby. Leave all this quarrel because it will impact baby. Trying to act innocent.

I have been calling her and texting her since last night scolding and requesting for reply, but she dont. Blocked my number and living peacefully.