Frustrated need major advice (Long sorry)

Dziko
So I have been with my SO for 4 years married for a year and 1 month he recently lost his job but even before that things have been really hard. Two years ago when his grandparents passed away we uprooted our sales and moved across the country to take care of what we thought was his inheritance turns out there was no inheritance to be had because of Dad moved in and stole everything so at that point we move to Atlanta, then Birmingham and now Florida. We have never lived on "easy" street. The entire course b of our relationship has been one problem after another. Now that it looks like we will be moving again, I just don't know if I can continue with this relationship it's not that I don't love him but I feel like I need to start loving myself more so many promises have been made but most of them have not been following through being that we have to move it seems like every 6-8 months I'm not ever able to get settled anywhere and work on my career or towards my education start a family anything it's always a few months of kind of easy and then drama. Lately it seems like we are more irritated with each other and I realize that a lot of that is caused by the stress of our situation last night we got into a fight and I asked him afterwards, it was not a major fight, I asked him if he would forgive me and he said I'll never do that and that's not the first time I feel like he has a catalog of things that I've said or done that he didn't like that he holds in just allowing himself to be angry about them forever and ever I feel like he has no compassion and no forgiveness for me or towards me how can you make something work with someone when they hold grudges to throw back in your face