Had sex with my ex!

This guy and I were in a relationship for 5 years and it was a great relationship but three weeks ago I broke it off because I couldn't wait for him to get his shit together any longer and it's been 5 years already! I'm tired of waiting of being proposed too. ( also he's really timid and he's "okay " with being okay-- I want someone to be aggressive in life) Ever since our break up , we only talked like 4 times but we would always argue about things. we started argueing yesterday over text but then he asked to see me. I knew it was a bad idea but I have been so upset about this whole thing and annoyed with argueing with him that I agreed to see  him. 

I got into his car and he asked for a hug and just started talking. He gave me a kiss!! It felt really good and so passionate but I stopped it and I insisted we talk. We talked and kissed but fuck I was getting so confused !! Fast forward , we had sex two times in his car. 

I feel so fucking confused !!!! I hate it. He wants this with me but I just want my space. I agreed to just seeing him once in a while..... Idk if that's a bad idea ? My sisters make it sound so easy to break after 5 years... 

I want him but I want him to grow up!! There are some things I'm not happy with and I just want to have some space and have no obligations to him ( I don't  mean to have sex with everyone) When I was in a relationship with him he was my bestfriend but i felt isolated since I spent all my time with him. 

P.S the world( my family) is against us 

I really feel confused.... Did anyone feel the same ??