Fair weather family?

Anyone's family only in it to help when everything is going smoothly? My in-laws say they're here to help at any point but as soon as my LO goes to the bathroom in his diaper or starts to fuss they give him right back to me. Like immediately. They only want to help or hold him when's he's partially asleep and being "good". My husband gets mad at me that I don't want them around to help more but they don't help at all and we just end up spending the afternoon entertaining his family rather than them helping.