Problems with my husband

So a few months back my husband finally told me he was ready to start trying for our first baby. I was so excited when he told me this. I am so worried we are never going to get pregnant though. He never wants to have sex like seriously it's maybe 3x a month if that. I just don't understand why he never wants to I have tried to talk to him and he just says he is not in the mood. I have tried many other things to get him in the mood and he just pushes me away, yells at me or ignores me. I am lost and don't know what to do. I feel like we are never going to have a baby and I want one so bad. Any thoughts would be helpful thanks