Told him I felt used and he cursed me out

So my fiancé and I “live” together. About 3 weeks ago, we had an argument and I left for a few hours to get some space. Because I left he said I couldn’t come back until he allowed me too. He kept bringing me clothes and wouldn’t tell me when I could go back, and when he gave me a date he would change his mind. I told him that if he doesn’t want me to move back at all then say that and he said he was just hurt by me leaving every-time im mad. I understood that but he doesn’t seem to want me back at all. It’s been several weeks. Last night, around 1 am, he told me to go over there. I was excited cause I thought I would be moving back. When I got there he was in his boxers, and his penis was hard. I got undressed and we laid together. We were both touching each other then I gave him head. We went to sleep after that. In the morning, he kissed me goodbye and went to work and then I left to work after him. So today, after work, I asked him if I can come back home and he tells me no… so I told him not to call me during booty call hours unless it means I’m going home because I just feel used. He could’ve just disagreed but instead, AS USUAL, whenever I say how I feel, it turns into an argument. He called me cursing at me and yelling at me. I was under the Impression that he was going to let me back home since he called me over and let me sleep there with him.. maybe I’m wrong in all of this. What do you think RESPECTFULLY?

Yes I know I need to stop storming out when I’m angry. I have acknowledged that, I have apologized, and I’ve had every intention on doing things differently moving forward, but he doesn’t seem to want to give me the chance nor does he want to break up.. so what do I do?

I thought he was allowing me to come back because he invited me over and he was letting me sleep over, NOT because I gave him oral. That was the first time I’ve been there in weeks and I thought that was a sign of progress.