Cheating husband

Me and my husband have been together for 6 years, married for about 2. We have 1 child and 1 on the way. Prior to this I could barley catch my husband looking in another woman’s direction. About 9 months ago my husband spiraled out of control. We had a rough path with fighting over nothing but really just not appropriating each other. So when I learned of he was talking and flirting with another woman I was shocked but could almost understand how it happened. I personally never went outside our marriage but definitely was deprived of attention. I found this woman in my home, I was furious! At that moment I could not prove an affair: but I knew If it hadn’t already occurred it was going to. I chose to stay but wasn’t over the situation. In the mean time my husband promised to cease contact, I found I was pregnant with out 2nd child. I almost had a miscarriage and ended up in the hospital. This child is a soldier because he wasn’t going anywhere. A week later I found my husband at a hotel after lying to me about going to work. She was leaving a few days later for a year out of country. Now I was stuck I was several months pregnant, I was already under to much stress and couldn’t risk a messy divorce. My husband who didn’t want to get divorced would have fought me. So i agreed to stay untill the baby was born. I still have been undecided of leaving or staying. The fact he cheated, the fact he lied and put me and our second child at risk haunts me. Since then my husband has made every attempt to show remorse and give me the marriage I wanna wanted. It’s very easy to make him a villain but he isn’t a terrible person. He screwed up every aspect of his life in various ways. Got in trouble at work his family his friends and me. My therapist who’s a guy.. mentioned having a hall pass for me if I felt that would even the playing field and allow for recovery. Just looking for feedback? My husband has expressed fear or me leaving or cheating in retaliation. We have a good life Together and actually work well and get along but I feel I can’t forgive him. Would me having a hall pass even if I chose to never use it... help??