Really need help :(

I went to visit an ex boyfriend (mason) of mine because he was getting back from the marines and he is one of my good friends. Tmi I was wearing a dress and the first thing he wanted was sex. He took off his clothes and took off my underwear. At first I was okay this is alright and he put it in once and we stopped. I was thinking about my ex (Brandon) who now wants nothing to do with me. He thinks that we had sex and he came I inside which isn't true at all. I came home early from masons house I was at because he wanted to have sex all the time like no lie he asked six times in two days. So do I just let Brandon go or do I just try and talk to him....