When you are left with no energy

I recently making amends with a family member after so many years but it just seems their struggles are emotionally draining me. I care about them so much and feel sorry, except that I feel numb after talking to them, it consumes me. I’m utterly confused by my emotions. My husband advised me to keep the contact but to a minimum, less frequent to keep my peace of mind. Anyone gone through this and what to do?