Was forgiven

I was forgiven after sleeping with my lover brother. He asked me to hang out and I felt like its was just to have sex. So wen I told him I didn't wanna be a hook up he got all defensive calmed tht he wasn't tht guy. Idk what I did wrong and now he's not texting me back. What should I do