Please no rude comments . Any advice would be appreciated

So my husband and and I have came along way in our relationship. We learned a lot about eachother and grew so much as a couple, we also had a baby this year and life's has been a great roller coaster I would say! If that makes sense. So when my husband gets upset about something it's hard for him to control his anger, he's definitely doing a lot better at working on himself to control it but there are times where it's harder. I also play a big role and I been so much better at communicating, supporting and taking any burden he has off his shoulders so he also seems to be much calmer but today he got so mad using the F word because the bank he uses screwed him over and he was trying to fix it but they were giving him a hard time I know it sounds like he might be over reacting but he's been overwhelmed cuz we moved across the country recently and he had to do it on his own unfortunately I couldn't help him so he has a lot going on with just moving starting a new job An having to live with my family cuz we're saving for a house so space for us is limited! I don't mind him getting upset but using bad Language and somewhat letting it out on me is not ok, I also tell him he needs to be careful since we're not in our own house yet that other people will hear, but it's hard for him to calm down so today I left the room so he could calm down and let him take a break, he also wanted me to leave cuz he didn't wanna swear in front of the baby or me, after that I just got in a bad mood and felt sad so we ended up talking about it before bed and I even cried he seems to be understanding and said he's sorry but I don't know how long that will last. I been writing him notes to tell him I'm here for him and not to get so mad when not happy about something. Basically trying to communicate with him. I guess my question is if anyone has advice to help my husband with I'd greatly appreciate it!