Vitex?

li
I just started taking vitex about a week ago exactly, and didn't think this cycle had worked...but boy was I wrong.. I'm 4w3d and worried about what to do? Like is it okay to stop it since I only was taking it for a week, is it even in full effect? Just worried about miscarriage if I stop. I also have pcos so kinda worried...