He doesn't care

I've been with my boyfriend for four years now, we are in love and I feel completely comfortable with him. However i feel like he doesn't give a shit if I finish too. Just because I take a little longer almost makes it like a chore. I want to have sex but his attitude makes me anxious, like I'm boring him. I'm tired of not having the same experience but I don't know what to do.