Passing Cysts with PCOS?!

I've been on Metformin for almost 2 months. The past three weeks I've escaped the every 5 minutes run to the bathroom episodes, but this past week I've been experiencing another symptom. I'll be in a deep sleep and then BAM this horrid cramp starts and feels like a knife at the bottom of my stomach/top of my vagina. I go and try and use the bathroom thinking that will help, and without luck, it still exists for a solid 5-6 minutes.