Left ovary pain

Jade

Im 6 weeks and 5 days pregnant and every now and then I will get a sharp pain in my right or left side right around where my ovaries are, should I be worried?