got into an argument with FIL about my baby

so yesterday me and my bf went to visit with his dad and we brought our 6 month old baby. everything was going fine except a few moments where we had to correct what he was doing. (he tried holding her by nothing but her arms when she can't even crawl yet) (he also kept bringing her down to the ground to make her see his dog even tho she kept crying) those things alone upset me and even irritated my bf but i tried to be understanding since he's old and hasn't been around a baby in a long time. well dinner time came and we decided we wanted to grab food out since nobody felt like cooking. i told my bf what i wanted and said i was gonna stay at the house with the baby so she can be comfortable. my FIL tried to tell me to leave her there with him and to go with my bf. i then explained that i had to feed her soon anyways (she's breastfed and won't take a bottle). and he continued to argue and basically told me to feed her before i leave (wasn't even asking). at this point i was clearly upset and i tried telling him about how she's at the age where she'll cry even if i leave the room and he started going on about how it's okay for babies to cry and that i needed to start letting her. i understand this but i wasn't comfortable leaving her with him especially since he had been drinking and he also smokes a lot and i was running out of excuses so i told him i wasn't leaving and he ended up giving me such an upset and judgmental look.

can i get some advice on what i can say to get the point across next time somebody decides to argue with me like this about my baby?

bonus: when i was trying to explain how she won't take a bottle because she's breastfed but that we were working on it, his argument was that i should be freezing my milk so that people like him can still baby sit.. like as if she doesn't still need a bottle to drink the milk from the freezer 🤦🏻‍♀️