I'm losing interest

I'm losing interest in my relationship. I'm irritated by him more often, I get annoyed with his silly jokes, the little things bother me now and I just feel exhausted in the relationship. But at the same time, when I'm not with him I want him around but once he's around I want him away. The sex is going from mind blowing to okay cause I'm losing interest. Advice please?