Slow weight loss?

I gained 38 pounds during my pregnancy (137 lbs to 175 lbs). I have lost 20 pounds of it at 15 weeks postpartum, but I am having so much trouble losing the rest of it!

I am breastfeeding, not eating dairy, and mostly only eat meats and veggies. What gives?!