Cruising with baby

Has anyone cruised with their baby before? I am torn on whether or not to bring a car seat. I know we will need to take taxis on the islands and I’m curious what other people’s experience has been. We’re going to Cozumel and grand cayman. Can we get taxis with car seats there?