Confused

I turned down my husbands advances and told him the only time he wants to spend time with me is when he wants sex. After that he told me I looked nice and gave me a hug and tried again I said no again. I want him to like me for more than just sex. He told me I never have to worry about him trying again he tossed the box of condoms in the trash and again I’m ignored. Did I just bruise his ego? It was not my intention to do so but I want him to try in our relationship. Do I stand my ground or go back to how it has been?