I’m afraid it’ll lead to rape

Sometimes when my boyfriend gets really horny and I’m not giving him sex, he tells me that he’s literally getting angry from not having sex and then every chance he gets, he’s shoving himself on me. Even if I’m saying I need to leave or just pulling away because it’s getting intense and I’m in the middle of doing something so I’m not quite in the mood. Idk it just feels pushy and sometimes I worry it’ll turn into rape. I know, I sound dumb.