So confused

Three years ago I left my boyfriend. I ran into a old guy friend during the split. now I’m back with my boyfriend , he still has bad dreams about me leaving and says I completely blew his confidence and he has negative thoughts. Sometimes I want to go back home to be alone since we still argue about that one split but I don’t want to leave him upset and we still have great times. What do I do? Will we ever get past this ...