I think it was consensual?

I let my ex talk me into coming over to fool around. Not my finest moment. That said, I told him before hand, we're not having sex. Ya see, in the time between now and when we dated, we both entered into year long(+) relationships that are now over. He lost his virginity in that relationship while I never did. As you might've guessed by the title, I lost mine tonight. 
We started making out and then he went to finger me, and then ended up pulling out his dick and positioning us so I was riding him without his dick actually going in. I expressed concern, and he assured me it was fine. Well while this "humping" was going down, he started thrusting up. I thought to myself "oh he must not actually be going in". I expressed concern, he assured me it was fine. Next thing I know, he's like "uh, you're not a virgin anymore". I know it sounds fake that you wouldn't know-- I would've called someone on it too-- but the whole time I felt bad pressure down there from him pressing basically right against my opening anyway. I freaked out and was like "NO. We're not having sex." But we continued with the grinding and every time he'd start thrusting and grab my hips and pull me down, I would say "no no no" and fight back so I didn't slide down (because I was on top). But after this happened multiple times, there's was no denying that he'd definitely been inside me on multiple occassions. In which case, I was like "well there's no point in not having sex now since you already took my virginity", so I consented to sex. 
That said, during sex, I kept stopping and telling him to wear a condom, and then he would just start again without one. I told him flat out "I don't want to have unprotected sex" but he kept saying it was fine and he would continue and I would give up because it felt so good. 
YES I know the dangers of precum. However that's only a problem if he hadn't peed since the last time he came, and I'm pretty sure he had. Besides, I'm getting my period in a week, so I shouldn't be fertile anyway. (He didn't cum in me). Birth control isn't an option for me, and no, I will not be returning to his house for another round. After, he started taking about school. As if it didn't happen. And then I went home. 
I just want to know if you guys consider that rape or not? I know I definitely didn't consent to most of it, but I also didn't fight it/liked it. 
Clarification: I couldn't tell he went in at first because what we were doing before just felt like uncomfortable pressure against my opening. I didn't really feel that change, it was still just pressure (I'm assuming it was just the tip anyway at first. He obviously knew immediately.) Also while we had been grinding like that, he had been sliding in a finger from time to time so there was no shocking "I just got penetrated feeling".