Everyone thinks I'm spoiling my newborn baby...

My grandma and my mom even my boyfriend keep telling me that I'm spoiling my 3 week old babygirl. My boyfriend says to just let her cry it out but I think that's so cruel because she's just a tiny baby and doesn't know any better. So I always pick her up when she's upset. (Which usually ends in a fight) Now I'm scared to go back to work in 2-3 weeks because I feel like my bf is just gonna let her scream when I'm not there.