I'm not happy anymore

Super long post, I guess I just want to vent. Been with my husband for 4 years. First 2 were amazing. He doesn't have kids, and I had a 2 y/o when we met. Sex was amazing- best ever. Our time was great and playful. Around the 2 year mark we talked about having a baby and my daughter is calling him dad. We did shit together, took trips, visited family and friends. Got married. I guess we "settled in", have had no luck getting pregnant and I mean I'm doing everything possible. He drops on me that he has retrograde ejaculation and prob cant have a child naturally after 2 years, ok that hurt but not the end of the world. Hes found a new interest in guns and its literally all he does. We could prob afford iui/ ivf if he didn't buy more gun shit. I find myself alone with daughter all the time now. Hes always on his phone and has 0 patience with me and my child. Our sex life is based around trying to get pregnant. He never wants to go anywhere. I tried to take a break and ask him to go stay at his moms about 8 months ago..he cried and cried about how he needed me. So I felt a little relief- ok he does care. He kissed ass a little and was right back to his ways. Anniversary came, vday, bday, Christmas which we've always celebrated, he done absolutely nothing and said oh you should have told me we were getting each other something. Last night I wanted to go to my cousins for new years, he wouldn't go. He told me he just didnt feel like it so I left and came home about 1130. Tried to cuddle and he complained bout being uncomfortable, I eventually go to bed. I wake up and hes in the other room sleeping. Which he does often when we disagree. We dont really argue, we just dont talk. When I do talk to him about issues- I get emotional and he HATES it, he always says "oh so it's me' literally everytime. Its never just him and I never say that. I'm totally unhappy and lonely. I struggle with deciding if I should stay in this bc were married or just let it go completely. Has anyone been here? Isn't it suppose to get better, when?