Feeling guilty over something I kept from my boyfriend

My last relationship was terrible. He talked trash about my family, he was rude to his grandma, and he never treated me like an actual girlfriend. I was more of a friend with benefits but I had the title of a girlfriend if that makes sense. I knew the relationship was over and I had no feelings for him a couple months before the relationship actually ended. Once thing started getting really rocky and I tried to encourage myself to just break up with him already, I started talking to one of my coworkers more often. I knew I was attracted to him but I couldn’t go any further while I was still with my bf at the time. So I finally told him that we were done and I didn’t want to stay friends or contact him ever again. Idk what was wrong with me but I still continued to talk to my ex and i was in the “talking” stage with my coworker. I was going back and forth between if I wanted my ex still but I had told my coworker that I was done with my ex and I wanted to be with him instead. So we continue to get to know each other and go on dates but I still had contact with my ex. Then my coworker asked me to be his girlfriend and I said yes. I felt the happiest I had ever felt in a long time. I completely cut off my ex and focused on my current relationship.

Now we’ve almost been together for a year and things are great. I’ve never had a relationship like the one I have now. We communicate well and we never yell or argue. We have disagreements but we are civil with each other. We’ve been through a lot together. I was temporarily living in hotels because my family and I were evicted. I got pregnant and had a miscarriage. But he was there for all of that. He never left when he easily could have. Recently I’ve started to feel extremely guilty for keeping the fact that I was in contact with my ex longer than I had said. I get these moments of panic where I feel like if I tell my bf or if he finds out he’s never going to forgive me. We weren’t officially together when I was still talking to my ex and while we were in the “talking” stage, we never said we couldn’t talk to anybody else but each other. I’m not trying to justify what I did, but I just don’t know what to do