Feeling discouraged

Elokin • Ttc that precious little girl after having 2 teen sons
So hubby and I decided to try for 1 more at 41. We have two teenage sons, and figured let's try for a little girl, he was all on board. Been trying 2 months this is our 3rd. Tonight he decides maybe it's a bad idea, we r not young, he says his energy is not there, says he doesn't want things to change, like his gaming time be gone if we had another. I don't work by choice, I think having a new baby would be wonderful. But now he has doubts. Am I crazy for wanting a baby at my age? Feel like crying... Sorry just a bit of a vent.