Clomid/Vitex

Hi, so I was recently diagnosed with PCOS. I had always had the feeling I had it but never had the guts to go see a doctor. Anyway, for the past four to five years I've had a significant amount of hair on my chin so I was always plucking them away. After being diagnosed and finding out I had vet low progesterone levels I started to take VITEX. After three days I noticed a significant difference in my chin there was way less hairs and it wasn't dry AT ALL no flakiness nothing and the dark spots went away. I went to the doctor on Tuesday and he prescribed me Clomid 100 mg, I read online to not take the clomid or the vitex together because they cancel them out. So I stopped taking the vitex and my chin is back to being very dry with dark spots and flakey and of course more and more hair. I am to take my first round of clomid at the end of august, my question is can I take the vitex up until the week of period and the Stop to take the clomid and then start again? Has anyone taken it like that? I know I have to consult my doctor and I will when he gets in the office Monday just wondering if anyone has done the same