Husband doesn't want second pregnancy

We have a wonderful 2 1/2 yo boy and always planned on having three or more kids. My husband is 43 and I just turned 32. I am begging him for 1 1/2 years now to work and on baby #2 and he basically comes up with a new excuse every month. He is purposely not sleeping with me even though he knows how important it is for me to have a sibling for our son. For the last three months he is even using it as a punishment. If he doesn't like a certain behavior he says that's it I'm not sleeping with you this month! I'm sorry but how fucked up is that?! He says he doesn't have enough energy and doesn't want to work so hard to make money for more kids.

But I think he just misses his bachelor life and hates making sacrifices for his child. I work in a full time job and the whole household, the boy and everything is on me, he's literally not doing anything but his job.

This sounds horrible but I feel let down and consider a divorce. A second child could possibly make it even worse at this point.