Anyone else having trouble gaining weight?

I'm 16 weeks and early in my pregnancy I lost 10ish pounds. I have not gained any of it back and even lost a couple more. Is anyone else having this issue? Any recommendations on what to do? Doctor said to not worry yet, but I can't help it.