Indifferent spouse

I feel like my husband is completely indifferent to whether or not we have a baby. He's great with kids, and we've been TTC. I can't tell if he's just trying to help me not feel pressured or stressed, or if he just doesn't care. He just says "I want whatever you want" when I ask him about it.
It makes me want to just quit trying all together sometimes. 
Anyone else's husband like this?