Possibility of Zika putting a damper on our parades

My husband and I went away in August on a cruise for 2 weeks to the Caribbean. The cruise line told us about the possibility of Zika being at one of the ports we were going to. So my husband and I have been taking precaution ever since coming back from the cruise by using condoms. My husbands brother travels to thay one specific port a lot for weddings because he is a wedding photographer and he said hes never gotten Zika and that its not as bad as people say it is..... My husband and I really want to start a family like yesterday but this whole cruise thing has us bummed out. We both have such baby fever that I am to the point of saying let's try but at the same time I think about the possibility of one of us having Zika. I really don't want to wait till March to start trying.... Need some advice please 😀