What to do

This guy and I were dating for a couple months, 6 months ago. We ended things on civil terms because I didn’t like his lifestyle, drinking smoking. hung out a couple times since as just friends and a couple times where things went further than they should have. Now my feelings are back towards him and he knows, but says he doesn’t want to set me up to get hurt. So now I’m feeling torn on what to do. I really care about him and miss the old days and idk why I can’t get over him.