Babymoon in Key West? Thoughts about Zika....

Hi Ladies! I need your professional opinions. Our anniversary will be in November and I will be in my 2nd trimester at that time (perfect for babymoon/anniversary combo trip!). Anyway, we want to go somewhere warm in the US and really Key West FL is the only tropical kind of place. But, I'm worried about Zika. The CDC has removed it's warning in Miami Dade Co. and it looks like they never had an issue in Key West, but I always just lumped all of FL together in my head as off limits for Zika reasons. Please share your thoughts! Should we go, or not risk it?