Should I get back with an ex?

Brandi
This is a long story that I'm cutting about half out because it's not super important. About four years ago I was set up on a blind date with a guy, lets say his name is J. We hit it off right away, and the more we learnt about each other the more we fell in love. He had to go back home since he was military, and we agreed to have a long distance relationship. About 2 months later he tells me that he was still married and didn't want to leave his wife. I had no clue he was married. We parted ways, with my heart in pieces. 
This past week he emailed me out of the blue to tell me that he's still in love with me. He sent me copies of divorce papers, was pretty much begging for me to give him a second chance. I want to because I'm still in love with him. The guys in my family don't care, as long as he doesn't hurt me again. The girls think I should run in the opposite direction. Problem is I really love him and always compare other guys to him, which isn't fair to them. 
Help please.  Should I give him a second chance or just walk away?