Fast sex 🙄

Almost every time (I'll say 85%) my boyfriend and I have sex he always cums super fast. He always says it's my fault. It's annoying, I haven't told him it's annoying I just roll with it because I don't want him to feel bad or embarrassed. What should I do so our sex can last longer?