Cysts on ovaries

I recently went off the pill and found out I have cysts on my ovaries, doctor said they should self resolve but I’m still in huge amounts of pain. Any tips on how to reduce pain? I’ve tried hot packs and pain relief medications, it helps but not much.