venting

I am married for almost 3 years. My hubby and I just had a baby he is 3 weeks old.. I love my husband so much. But while I was pregnant he had told me he wasn't attracted sexually to me because I was "big".. that offended me.. Now that I'm not pregnant anymore he touches me (like grabs my butt and boobs) and I tell him not to touch me.. idk if it's the hormones but I don't want to have sex.. I'm not healed yet still recovering a tear during delivery. But when I am healed I don't think I want to start having sex again... I haven't had sex since I found out I was pregnant and kinda got used to not doing it.. Am I wrong for not wanting to