Did fucking someone you ever loved help the situation or make things worse

This guy and I used to talk for a couple weeks and I fell for him hard, he went back to his ex “apperanlty because he was scared to be in another relationship”, we didn’t talk for a whole year and not a day went by that I didn’t think of him. His best friend ended up taking me on a trip out of state and we ducked, he started a whole bunch of lies about me to he whole school, it’s been exactly a year and he left her for good this time and we started talking agin. It’s been almost 5 weeks, we y’all 24/7, we hangout a couple times but most of the time we are never alone, for the most part I feel like he likes me but theirs a little part of me that thinks he just wants to fuck and I asked him when he was drunk and he said let’s fuck and then see where things go. My friends tell me not to do anything with him because I’ll get more hurt even tho that I do want to have sex with him. I need advice on if this is a good idea and take the chance or if things are just going to leave me destroyed