Lost weight

At 5 weeks I weighed 115.4. Today I am 6 weeks and I weigh 110.6. I don't have much of an appetite, but is this normal? I'm worried. Shouldn't I be gaining weight at this point, or not yet?