Vacation at 31 weeks-should we go?

So my husbands family goes to Hilton Head Island every single year. They pay for the house and everyone stays for free. They scheduled it this year and I will be 31 going on 32 weeks during the trip. We will drive and it’s only about 4 hrs. My husband doesn’t want to go because he is scared about me going into labor or needing to go to the hospital while being there and closer one is in Savanah about 45 minutes away. I’m currently 28 W 1 D and have had no Braxton Hicks/contractions or swelling. Just rib pain from baby being breech and considered low risk. My husband is just so worried something is going to happen which then makes me worried... would you still go or just stay home? There will be plenty of more trips there in the future so we aren’t missing out, but it’s the last vacation just the two of us.