My baby always cries when I hold him..

My 6 week old son always seems to cry and be unhappy when I’m holding him...why? He’ll be fed, changed, burped, everything..and you think he’d welcome the comfort of his own mother but nope. I try walking around with him, changing positions, rocking him, swaddling him and he just screams louder. To the point I just give him my breast because he’s only happy on me when I’m giving him my breast. He will give me smiles and be alert a small window of the day but it’s when I’m interacting with him on his Boppy pillow, not while in my arms. Most people probably have the opposite problem with their baby never wanting to be put down. He used to love sleeping on my chest when he was a couple weeks old, and now it’s like he hates me. Grandma comes over and he’s suddenly content to be held. Sad 😞