Confused and Regretful

So me and this guy have been friends since high school. When we are about 18 or 19 he wanted to be with me, but I declined, because I didn't know what to expect when being in a relationship and I was scared so we remained friends. When I was 23 and he was 24 he was in a relationship and I was single, but every time him and his girlfriend got into it he would call me and tell me and I would always be there, but some how they always fix their issues now I'm 26 about to be 27 in a month and he's 28 him and his ex are now broken up after four years because she said she's not in love with him anymore and she cheated on him multiple times. Now here's the issue they still live together with her brother in a house like two months ago I went to go visit him and confessed that he loves me he always has, but I love him as a friend. So over the weekend he met my entire family and they actually like him, after that we spent the night together and we had sex it was the best I ever had, but  he confessed that he loved me, and I didn't say anything the next morning I expressed that I regret us having sex because I think it would mess up our friendship and basically we got into an argument, because he told me he didn't regret anything that he really likes me and he not out here trying to play me, but I feel like I'm a rebound, because of his current situation. He's been trying to reach out to me  me, but I really not trying to talk right now. What should I do? Should I feel like a rebound or just try to talk to him?