He asked me how I can be 24 and not want to have sex....

So last night I was exhausted... And my SO and I had been mad at me for something I didn't do. I got home from work already exhausted and had to talk to him about whatever it was that had been bothering him. I don't live with him so I had to go home around 8...it was about 10 minutes to leave and we usually (almost every day) have sex before I go. But I was too tired. Even for him to do all the work... My body hurt and I didn't want him to feel bad so I told him I was really tired and I'll make it up to him the next day. Bear in mind we hadn't even started anything yet.. So it wasnt like he was kissing up on me and I rejected him or anything. I knew we'd have probably done something but I just wasn't up for it. He got mad... Started telling me to get dressed and go. I kept trying to talk to him and he just got angrier. We talked for about an hour. He kept saying I know how he is (he likes sex). Of course I know that... But does that mean I don't get to be tired? The part that got to me was in 24 and I'm saying I'm tired.... So I just can't be too tired to move my body? There have so many red flags... But I've been with him for almost 7 years... When I think of leaving I get scared... He's a great guy but lately the cons are outweighing the pros and I find myself taking the blame for everything. I'm always so scared to say anything when it comes to sex cuz he'll say I'm rejecting him. But last night I was just too tired to move.... I don't know what to think.... I'm afraid we'll get married and I can't have a say when it comes to sex because I know he likes it and I always have to do it even when I don't feel like it....