Should I be concerned about how much weight I’ve lost?

I’m 6 months postpartum, weighed 193 before giving birth, then down to 163 2 months ago. I started walking and eating less carbs/overall less food, and dropped to 159 in a few weeks. I haven’t worked out in a week but have continued to lose another 3 pounds. I have been avoiding bread and sugars and usually not eating much, as well as exclusively breastfeeding. Is this amount of weight loss normal? I’m a little concerned because I haven’t actually exercised in a week but am still dropping.