I don't know what to do...sex is making me sad

In short...we've been in a relationship for 4 years. It's a good relationship, we love each other. Also, we've lived together for about a year. However, his sex drive has decreased significantly over the past few months. It leaves me feeling undesirable, unattractive, vulnerable, unfeminine, and just sad. When I do try and please him (through oral or sex), it seems like I can't do my job. I feel like I can't please him, and therefore I get more discouraged. It's getting to the point where sex, and thinking about sex, is almost a sad thing for me.
A few days ago, I tried to give him head, and I couldn't make him cum. He told me to just relax and shower to get ready for bed...when I got in the shower, I just cried because I felt so discouraged.
He says I'm not doing anything wrong, and that I shouldn't stress about it...but we are down to having sex maybe twice a month. I feel so upset. I don't know what to do.