Gestational diabetes

So i found out i failed my one hour test by 4 points. The nurse said i probably failed because i don't eat sugary foods or drinks so it overloaded my system. Awesome. I told a few people i have no intention of doing the three hour test and have now received a slew of mean comments about not thinking about my son's health. My husband has told me don't bother with the test. I want opinions. I have to pay for this out of pocket because i have not met my insurance deductible. Should i do the test or given the reasons the nurse said i failed, not do the three hour?