Yeast infection

So I’m 10 weeks pregnant & I THINK I have a slight yeast infection. My next OB appointment is 6/4. Can I do over the counter yeast infection medication until then ? I’m just nervous that if I don’t have a yeast infection then I’m taking unnecessary medication.