My baby doesn't like me

I feel so sad. I am sitting here balling my eyes out. Evey time I have my son, hold him talk to him play with him he ends up pitching a fit. Starts crying, screaming and squirming. I try to stay calm but I get overwhelmed and have to walk away. When he is around my hubby (his dad) he is all smiles and giggles. I don't understand what I do wrong. I feel like I am not cut out to be a mom. I really dont. I'm so heartbroken and depressed inside. I just want to give up and walk away. He doesn't like me. He really doesn't. I just don't know what to do anymore.