In-love with my Ex

At age 18, I fell head over heels in love. He was everything I had ever imagined in a boyfriend, 9 months into our relationship I lost my virginity to him but had to break it off because my parents did not approve of our relationship. Long story short, I got married to someone else and so did he but always kept in contact with each other. 17 years down the line things began to really get intimate between us again, let's just say we are confessing our love in ways we shouldn't have. My love for this man is driving me crazy, I don't love my husband but we do have kids together. What should I do? Please do not judge me.