Friends w/ Benefits/ Feelings; Advice

I’ve known this guy for 3 yrs. & it was an off & on thing. I would get attached to him as soon as we started talking again & really I think he just wanted me for sex. So recently I told him that we could have sex but as (fwb) because I knew I didn’t want to have a relationship with anyone & I just wanted to lose my virginity. So I lost my virginity to him 4 days ago because I was comfortable with him. But then he says “it’s a one time thing” & that we shouldn’t tell anyone about it, which I was like whatever when really I liked the sex & wanted to do it again but I didn’t tell him that. & we told each other we’d go our separate ways but still be cool with each other. Then the next day I seen him talking to his ex & then I got a jealous & sad. So then yesterday he texted me again saying he wants to do it again & i kinda want to do it because I miss him & I always hope that me & him could actually end up together, but then if I do, do it again I’m just gonna catch more feelings & hurt myself. Idk what to do 😔