Ovarian cysts! (Not pcos)

I get a cyst on one ovary every month, my other ovary doesn't ovulate, so the only way to get pregnant is to take birth control, then stop and hope the cysts stays gone long enough to get pregnant. Well, the problem with that is, every time after I stop the bc a light two/three day period comes.. does anyone else have this problem and have any ideas? How long should I take bc before stopping and trying ttc? remedies to keep cysts away without bc? thanks! :)