How to repair my relationship

A little background. I feel awkward giving compliments to my now husband and always have because he always denied them. He asked me a while back why i dont give him compliments like he gives to me and we got on to the subject that he thinks i dont like his c*ck. I told him i felt weird trying to compliment him this way andsomehow we got into a conversation that made him think that i think he has a small **** by saying its not about what you have but how you use it. Not telling him that he has a small one, because he doesnt. He still references this argument thinking im not physically attracted to him and he says im always.saying.bad stuff about him (that was the only time ive ever said anything to insult him even though it was unintentional) when i dont initiate sex. I'm physically attracted to him I'm just afraid hes going to think I'm only doing it to appease him or think im not enjoying myself or that he'll just reject my advances (which he often does now). How do i repair my relationship and his self esteem? I feel at a loss.