Communication issues

My husband and I have horrible communication issues, not from my part but from him. He doesn't express himself and he takes any joke or sarcasm very personal. We have a 2 month old son and he hasn't been supportive during this time and we fight like every couple days. I decided that since I'm breastfeeding and I don't want to be giving the baby all my emotions theu milk I would take a break and visit my family up state I ask him and he said it was fine (mind you we had just had a fight a day or two ago) but why do I feel guilty? And I feel like I shouldn't have but I was close to having an anxiety attack. I've been at my family's for 4 days I e text him pics of the baby and stuff but he hasn't bothered to even ask about the baby how's he doing or anything 😭it really breaks my heart. Idk what to do I don't want my marriage to end