my husband talking to his ex and other woman

So, I've been with my now husband for 8 months. We met at an online dating web site and we hit it off well since day one. Well I found out a month later that he had a long distance relationship with another woman. So, he was honest and told me what was going on. Well anyways. I moved in with him 2 months after we met and he was still talking to this woman and he kept making plans with her if she ever came to the USA. In Feb he told me he wanted me to help him with his legal situation and I said no and he told that girl he want me to help him get his green card but didn't want to lose her because he cared about her. A few days later he got pulled over and taking into custody because he doesn't have a drivers license. He was in jail for a month and I was the only one to help him and he was surprised that I was doing everything for him I even hired a lawyer for him. I had to pay a $10,000 cash bond for immigration so he could be released. When he got out he said he appreciated everything I did for him and now values me more as a person. Well he stopped talking to that other Woman until yesterday that he sent her a message just to say hi. But the woman intentions are that she wants to be with him and I get jealous. So, now that he started the texting she will not stop texting him. He says he loves me and wants to be with me. Oh and yeah we got married 2 days after he got out of jail. He says he doesn't want to lose me but he also download the app in which we met but he said he deleted it because doesn't want me to be upset about that. So, should I worry he's talking to his ex or should I let it go? But he really wants us to have a baby and a family.  Sorry it's a long story. Thank you. I have no one to talk to about this.