Worried I can't get pregnant

Well I was on the patch (inconsistently) for about 4 months and I stopped it completely last month, I'm just worried because I hear a lot of people say it can be hard to get pregnant after the patch and I regret taking it so bad! Has anyone stopped the patch and gotten pregnant fairly quick?