Husband is Upset that I Suggested He Get Healthier while TTC?

Ladies, I had a serious talk with my husband about our health habits while ttc. We’ve been trying for a few months, all the while I’m taking prenatals, working out and eating better, working on my sleep, cutting out drinking alcohol and caffeine, you name it! On his end, he still smokes hookah, stays up late playing video games, eats fast food on days where he works 12 hour shifts which is 4 days a week, and hasn’t put any effort into working out. I’m not trying to make him feel bad, but I told him today that I think we should put off TTC until he works on improving his health.

He got a bit upset and said he’s stopped drinking and doesn’t smoke the hookah as much, which is true. However, hookah to me is something that should be cut out entirely at least aside from anything else. Especially when he’s not working out or doing anything else to get healthier. I told him it feels like it’s just been me putting in the effort only to be disappointed with each AF, even blaming myself for not conceiving faster meanwhile it may very well be something on his end, yet he just seems totally calm and fine. His sex drive is low, and he says it’s because he’s insecure on how he looks and feels. I’m trying to help him by making healthier meals, encouraging him to workout with me, etc. All to no avail.

So, is it wrong for telling him to put off TTC until he tries to make some lifestyle changes? We aren’t in a rush and are young newlyweds, so to me, maybe putting it off isn’t such a bad idea. Thoughts?