My now ex-boyfriend...

Last time we fooled around, we were making out (which was decent) and he started getting touchy and started putting his hands up my skirt, I told him "no" and kept making out and slowly he started forcing his way up my skirt... I even started getting a weird vibe with him, then he forced his fingers inside me and started fingering me kind of aggressively even though, up until his finger were up in my lady parts, I kept a saying "no" and trying to get him to stop. he then kept going and said "you know you like it." he left and that was the end of our hang out and that was an event that contributed to my breaking up with him. I guess the reason for my post is that, I don't know why that made me feel really weird and  vulnerable... I just wanted some ladies feedback on this. I really appreciate your input!