My Story, thoughts?

Okay, so there's this guy who started texting me way back in August 2015.  Things got sexual over text fast (we aren't just horny teens). Since that day, he has talked to me everyday and made me fall in love with him. He made a ton of promises and plans with me, that never happened for many reasons; work accidents, deaths, etc.. I'd only seen him a few times, and had never been alone with him. Finally, we made plans to meet, that actually ended up working. However, the night before, he told me that he wouldn't hug or kiss me, and that I wasn't allowed to touch him because it's "his body." I obviously agreed to his wishes. The night we were together, I was dizzy and had a major headache. We talked for a bit, and then he started touching my ass and saying how soft my tights were. He then put his hand inbetween my legs and said, "Can I?" I took his hand away, held them in mine, and said, "(Name) I'm scared because this will be weird since you can't see it." (We were in a half public place so couldn't be exposed and I'd told him about a skin condition I have prior to so that's why it's be weird). He proceeded to say, "it'll be fine," and went ahead and fingered me. I told him I didn't want him to but he kept doing it. There was nothing else I could do in my opinion because he's strong so if I hadve tried to take his hand out I wouldn't have been able to. 
Thoughts? I'm wondering whether or not this is considered rape. It's been two months since this happened and I've cried to him about it pretty much every night since. I told him yesterday that he might've raped me and he broke up with me.