Help me? Idk what to do

So my SO and I are ttc baby #1 I want to talk about it more with him but he doesn't like to talk about it. When I try he gets mad and tells me to stop talking about it. But if he wants to talk about it he can. But that's not very often. Do you guys think maybe he wants to have a baby but he's not sure yet or what. I really want a baby and I don't want to if he's not ready.