CBD oil & breastfeeding

Before I was pregnant I took CBD oil for my anxiety and it worked better than other prescription medication given to me by my doctor. I could take a few drops and it helped me for days with my anxiety as opposed to taking my Xanax a few times a day and still feeling anxious. I asked about taking it while pregnant but my OB told me not to as there was not much data on it. I feel like she might be biased towards it though. Any moms use CBD oil while breastfeeding? Is it safe or not? Any info is greatly appreciated.