I need help/advice

My SO smokes, and he has been for most of our relationship, but he told me that he was quitting, so I believed him that it was a goal of his (he has mentioned a few times that he doesn't know if he wants to, but I figured he said that due to stress because he was still cutting the number of smokes he's been having). Anyway, we decided to try for a baby, and I'm pregnant now, im 20 weeks. And we got into an argument last night over his smoking and he told me that he really doesn't want to quit and that's why for the past 6 months he's been staying at the same number, and he told me that I'm controlling and always on his back about it. And I told him that I don't see how smoking is so important to him, he quit once before, and smoking does nothing for you, it destroys your health, my health, the baby's health, our bank account, and his time. It smells bad, you cannot cover the smell, and it's gross. It literally does not one good thing for him, but a million bad things. 
But even after all this he doesn't see it, like he knows it's a bad habit but he doesn't care what it's doing to him. 
I know I shouldn't have conceived a baby with him when he was smoking and it's important to me that I'm not with someone who smokes for the rest of our lives, and I don't want our baby to see it and think it's okay. But I thought he was quitting. 
Anyway my question is, is this really that big of a deal? 
Should I just get over it because ultimately it is his decision, or put my foot down and say I don't want this in my future?

Glow Resources

Let’s Glow

Glow is here for you on your path to pregnancy

Glow helps you navigate your fertility journey with smart tools, personalized insights, and guidance from medical experts who understand what matters most.

25+ million

Users

4.8 stars

200k+ app ratings

20+

Medical advisors