Nuva ring and fertility issues

So I just recently have gone off of the birth control nuva ring at the end of May this year. My fiancée and I decided we want to start ttc we’ve been trying since the end of May and still nothing which I understand this can take a while. Little back ground I had my first child back in 2010 and after having her I went on the nuva ring and have been on it ever since. I myself am healthy along with my fiancée. Before having my daughter I was on the nuva ring also and took it out to try to get pregnant and not even a month after taking it out I got pregnant instantly. So I assumed that this time around it would be the same but apparently not. Also this last year before we decided to ttc my doctor said if I wanted to skip my periods all I had to do was take my nuva ring out on the 4th week like I would normally for my period but instead of leaving it out replace with a new ring. Which I did skip periods but had some spotting randomly not much. I’m just wondering by me doing this did I mess my fertility up? Or even using the nuva ring causes you not to ovulate for a couple months after stopping it? Just looking for some answers and support.

Thanks!

Lauren