Weight after baby


So I’m not under weight anymore and I haven’t been for a while now but I still struggle with body image issues and counting calories. It hasn’t been bad at all during the pregnancy (except when I gained a lot of weight after Christmas but that’s normal for everyone I guess) my question is when is the appropriate time to start trying to get the baby weight off? Because I plan on breast feeding and I don’t want to stunt that by dieting or not getting enough food. I’ve heard that dieting during breastfeeding can cause issues with the milk.