Ovary area pain?

I've been taking the pill for two months and I'm on the first week on month three. I started getting a pain around I'm assuming my left ovary since 3pm. Its now 6pm. Its not agonizing but it is annoying. Its not really getting worse but its not improving yet either. Should I be worried about it if its not intolerable? The last time I had sex was uh... over a month ago. I used a plan b just in case because I was on my inactive pills still. Any advice would be magical. Thanks!