CBD pills/oil and fertility

I have been TTC #1 for almost 3 years. Stress has been pretty high. Do you think taking CBD will affect me negatively in terms of fertility?