36 weeks pregnant FTM please help!

I'm 36 weeks pregnant and have been having BH contractions for a few days now off and on, I have a dr appt next week but all day today off and on I've been getting extremely dizzy and lightheaded and idk what I should do. All I do is drink water or chew ice, and I thought it was from sitting or laying on my back so I lay on my side but it's still happening. Should I go to ER or call my dr office in the AM? Or just wait it out? TIA!