CBD oil and birth control? Help?

I’ve been on a combined oral contraceptive for about 2 years. I have been looking into CBD oil to help with my anxiety. I took a CBD oil pill today at around 5p.m. I remembered during my research that it was uncertain if CBD had any effect on birth control. I’m a little worried now because it does seem to affect it in some way. I had sex with my boyfriend today, unprotected and took my birth control at 10p.m like I always do. Should I be worried about the CBD oil? Should I get a plan B tomorrow? Does anyone have any experience with CBD oil and birth control?