Vitex during pregnancy

For all those who take vitex or had taken vitex can you take it during pregnancy? I've been taking vitex to regulate my cycles and I just found d out I'm pregnant but I just do t want to go and stop cold turkey I'm afraid because I know my progesterone levels are high right now and I'm afraid they are just going g to drop if I just stop taking it but I read in the bottle and it says do not take during pregnancy. Want do I do? I'm xo fused