Baby Won't Let My Mom Hold Her

My mom has been helping me take care of LOL since he was born. Recently we've been trying to switch him over to formula since I'm returning to work soon. The first formula we tried he did not take a liking and would put up a fight when my mom tried to feed it to him. After a few days and consulting with a nurse we decided to switch formulas. I introduced the formula to him and after he seemed comfortable with it I had my mom try feeding it to him. He started crying when she held him, would take the bottle but after finishing it off would cry again. When my mom tried holding him again later that day he also cried until I took him back. Could my baby be associating my mom with the formula he disliked? How can I help my baby be comfortable with my mom again? Any advice would help as I'm returning to work soon and my mom will be the one primarily taking care of him once I do so this is a quite concerning. Thank you!