Exhausted of trying with him

Im absoloutley exhausted with trying with my boyfriend, I'm so in love with him and I am so attracted to him. I still get butterflies when he comes home from work and when he gives me those kisses, but it's like he doesn't want me. I try kissing him and he will interrupt me, I try to initiate sex and he'll push me away. I've asked him why and he'll tell me he's sorry. So I've waited. So. So. Patiently. We have sex when he wants it, we had sex the other morning, he finished first, then left me hanging and went to work, this is the third time out of about five times we've had sex this year. I would never pressure him for sex, I don't constantly ask him and I've waited. I told him I have needs too and he responds with I know and shrugged it off. Why doesn't he want me anymore. What have I done to become so disgusting to him that he doesn't even want to make out with me anymore. He never used to be like this and it really hurts, he's the only person I have ever loved.