Baby slams fist against my chest

Have any of you moms experienced this while breastfeeding? My six week old son has been doing this since birth, but now mostly only does it now and again if he's worked up about something.

It's very deliberate, and tonight I noticed he was doing it if I was talking or singing to him to get me to stop, bc once I did he calmed down.

He never does this to my husband, and he smiles more for him and doesn't make a lot of eye contact with me compared to my husband...not sure how to feel about it