How much weight loss is too much?

So when i found out I was pregnant (at 3w 5D) I weighed 162.2 lbs and I'm 5 ft 6 in. And now at 7w today, I'm weighing in at only 153.5. Is anyone else having this much loss? When does it become bad for the baby?