My husband never wants to have sex with me....

I don't understand why, but it seems like ever since we got married my husband very rarely wants to have sex. If it weren't for me always initiating it, I strongly believe that we would almost never have sex. He swears that I turn him on and that I'm so beautiful and that he always wants me, and I know it's not like he's cheating on me or anything, but it seems like he just never wants to. I will be waiting at home for him in nothing but panties, or put on some sexy lingerie and text him something sexy before he gets home, or I'll snuggle up next to him in bed and start kissing his neck and he'll say he's tired. Or like just now we were in the tub together and the second that I noticed him getting hard and I acknowledged it he immediately said it was time to get out. He sat on the couch and turned on the tv and I put on a matching bra and panties he bought me and I laid on the couch and he started slightly fingering me, but didn't even put a finger all the way in and I told him to get on top of me and he goes, "I have a head ache". And laid down. I said, "Sooo should I just give up and go put on clothes now?" And he goes, "I don't care, that's up to you babe!" 
Is there something wrong with me? I KNOW I'm good at sex, and I constantly tell him he's good too... So I know it's not an embarrassment on his end or a performance issue on my end... He just never wants me and it makes me so self conscious. And then he wonders why I get so unsure and paranoid about if I look good or not.