Scared to have sex cuz he’s too agressive

I’ve been seeing a guy for a year now, I’m in my early 20’s. He’s very sweet and I’ve never had any issues of abuse or even an argument with him, but when we have sex he sometimes becomes scary because he’s so passionate and aggressive. He’ll become an entirely different person. Wont listen to me and will still try even though I’m saying stop. There’s been instances where he’s grabbed me even held me down during sex. Whenever I’m not in the mood he’ll start cuddling with me and being too aggressive and begging me for it. I really like him but it’s hard to control him sexually and I’m a little scared