PCOS and the Pill

I was diagnosed with some cysts in my ovaries some years ago. Not sure if it's 'full blown' pcos, but I had those typical symptoms: my period was never regular (there was one time when I was 9 months in a row with no signs of it) and I started growing some acne.

I've been on the pill for the last 2 years, and the last time I had a checkup, my gyn said that I had no signs of cysts in my ovaries.

Is it possible for the pill to fully eliminate ovary cysts? Will they come back if I stop taking the pill?

Xx