Sex & weight loss

My husband hasn’t touched me in 2 years. I decided to do a lifestyle change. I’ve been working out & walking 10,000 steps a day. I weighed 299 now I’m 264. Now he wants to touch me. I ask him to stop. Ifeel bad cuz he didn’t touch me & I feel bad cuz I don’t want him to touch me now after 2 years has passed. He sees my progress & decides he wants me now, no Sir. He has made excuses for 2 years why we don’t have sex but now he does want to.

Am I wrong for saying no?