How long did you ttc before getting pregnant with your second?

I'm a ftm and I got pregnant on my second cycle after trying. I was very lucky. But I was on the pill for 3 years then depo for 2 before trying. So we thought it would take forever. I've been told that if it's easy the first time it will be a struggle the second. I'm really worried that when we go to try for our second that it will take a very long time. I was just wondering what you ladies have experienced.