Baby dislikes certain people ?

My baby is almost a month old & she cries whenever my boyfriend or his mom holds her. My boyfriends mom was making me feel bad about breastfeeding saying that and holding her too much 🙄 are the reasons she won’t go to anyone and calls her a spoiled brat 😒😠

But I noticed when my boyfriends dad holds her she is calm. I recently took her to visit my family (my two sisters, mom & step dad) & she didn’t cry with any of them. Any reason why she is fussy only around certain people ? Hopefully it’s just a phase bc I hate my baby being called a brat and feeling like I’m a bad mom