Glucose test!!!!!

Hey guys. I have the glucose test coming up at the appointment after next I think. I will be talking to my doctor at my next appointment about it. I have had low blood sugar in the past due to consuming sugar so I rarely eat carbs or sugar because my sugar will go low after it spikes. This really concerns me with the glucose test because you consume a drink full of sugar... I really think it will cause my sugar to get really low and I will probably end up passing out from the low blood sugar... I know that can’t be good for the baby. I have been tracking my glucose 4x a day for the last 2 weeks. I’m only 21 weeks now. I have my appointment next week and I was going to talk to my doctor about letting me continue to track it instead of doing the glucose test. I’ve read where doctors can refuse to give you treatment if you don’t do the glucose test. I just don’t want that to happen, but I feel like pricking my finger 4x a day is the best option considering I have low blood sugar after consuming high-sugar/high-carb meals. I just don’t want my doctor to make me feel dumb or get mad. I don’t really know how to go about telling him. He’s already intimidating to me. Like I said I’ve been tracking my sugar and what I eat and I have it in a notebook And I’m taking to show him... anyone else went through this? It’s not like I’m trying to refuse it and im being careless.... bc I’m willing to track my sugar multiple times a day how ever long to make sure my sugar isn’t high. Btw my sugar has been in normal range so far... the highest number I’ve had after a meal was 107 and I had tons of carbs in that meal. My fasting number is in the 80s... any advice?