When to wean off Vitex

I'm so stressed about stopping Vitex! When did you stop taking it once you achieved pregnancy?