Vitex and Clomid

Okay so I just found out you cannot take vitex and Clomid together. And the fertility blend I take has vitex in it. Something which I asked my doctor about and she said "anything natural is ok" guess she dosent know wtf she was talking about! Ugh! Anyways. Has anyone else taken a mixture of vitex and Clomid and still ovulated? I dont care if it's multiples I am just desperate to ovulate and get pregnant! ):