Am I being mean or to honest?

Hubby is ok at helping out when I ask but when it comes to holding baby he’ll only hold her for a good minute or two before giving her back to me. And when I need to do something and hand her to him he gives this look like “really” then says “ ok it’s not like I’m busy” even when he’s just scrolling on his phone. I told him before that I get frustrated because he seems like he has something better to do but then he says I make him feel like a crappy dad. Am I wrong for voicing my feelings or do I come off as saying that?