Sex struggles

Okay so I have been with my boyfriend for a little over 3 years now. In the beginning sex was amazing yet I never really had an orgasm. Flash to now and the sex has been a complete shit shoot. Firstly he does not last longer than 2 minutes (sometimes even less) he gets angry about it and somehow I then feel guilty? When he can last a bit longer I try to move him in the areas to stimulate me and it just doesn't work. Foreplay is also a complete downer, and actually becomes some what painful (ferociously rubbing my WHOLE lady business). At this point I don't know what to do. I feel like if I voice my concerns he will just get upset. Seeing that last night I told him to ease up on the rubbing because it was starting to hurt and he just stopped ALL together. Super frustrating and would appreciate any words of wisdom !