I NEED AN OPINION

soooo... long story short i had sex with this guymore than once, strictly that, no intentions of dating. He has a younger brother who is so sweet and the picture perfect boyfriend he would always flirt with me, he found out about me and his brother but proceeds to flirt with me and we have been hanging out A LOT... what do i do????