9 month old swallowed button battery

So I got offered a job and left my child with her father while i went to do paperwork and drug test. When i came back home the first thing i seen on the floor was a busted toy, which was lying on the floor right infront of her dad. He was playing video games with a headset on and hadn't noticed it. I immediately grab the toy and start trying to put it back together to see if its missing any batteries, which it was missing one. I hurry and load my daughter into the car to go to the hospital, her dad went with us. On the way to the hospital he got mad at me for not wanting him to stop at the gas station for a soda. Started telling me i didn't know how to handle things. Does this sound neglectful and abusive?