Stopped pill today to TTC

My husband and I were trying to conceive with low sperm count for over a yr had a miscarriage then ended up pregnant 2 months later. Fast forward to now we just celebrated her 1st birthday and now we are ready to try for our third and I am more than ready to not have to deal with these birth control side effects! I’m nervous how long it will take me to rid the hormones I just stopped the placebo pills today and I’m on my second day of my cycle. Any advice?