Losing weight?

I’m about halfway through my first trimester and and I’ve lost 5-8 pounds over the last few weeks. I haven’t been throwing up.. but my nausea is so bad I don’t eat anything but crackers. I’m hydrated, but should I be worried? Should I call my Dr?