Taking too long.

My boyfriend and I have been together for two years. Of course when we started dating, we were always having sex and he always made sure I got off. Now that we’re past the “honey moon stage” and have gotten comfortable, we have less sex and I feel like he’s not as attracted to me. The other night, we were doing it and I was really enjoying it- but he finished and told me I was taking too long and he couldn’t hold it anymore. I have to really concentrate on having an orgasm and the slightest distraction can ruin it. Am I being too sensitive and should I make it all about him sometimes?? Help!