Ovary Pain

I have been having off and on pain near my right ovary for the last week or so. I am 6 weeks along. I keep thinking ectopic but feel like I am just stressing for no reason. Should I be concerned?