MIL and FIL

Nina • Baby Sophia 12-16-16
So me and my babygirl will be going to stay with my mil and fil with her dad soon and he expects me to let his mom and dad have her allll the time and never take her away from them when they have her. She's been with me every minute of every day for 3 months and I'm not ready to have everyone taking her from me.  I told him that I'd take her if she was hungry or needed to be put down or just flat out if I wanted my baby back. He thinks cuz I've been with her this whole time I shouldn't take her from anyone ever.  How do I go about taking my baby back without being rude or coming off stingy? TIA