Emotional hostage

I'm feeling like my man is holding my emotions against me. Whenever I get upset or hurt and I tell him, he says things like, "Here we go again..." or "We've already been over this and I'm not going to again." Then I feel like he intentionally doesn't reach out to me. I'm always the one making the stretch to fix things. It's so frustrating. He was in bad relationships prior to us and I think he believes that any argument will end our relationship so he immediately pushes me away. Any thoughts? I really love this man and I know he loves me, but breaking that cycle of pushing me away is becoming exhausting.