Does anyone else have a baby who just does not like them?

My baby instantly calms down when someone else holds him even people he doesn’t know that well but when he’s fussy around me I can’t calm him down and I’m his mother... he’s 4 months and it seems like he has not liked me since he was born. My grandma can always instantly calm him down and I envy her for that, I wish I could calm down my son 😞 it makes me feel like a terrible mother