Postpartum anxiety and breastfeeding.

I have been struggling with breastfeeding from the beginning, but have not given up. Now I have horrible anxiety that has been creeping up and I wonder if any other moms out there made the decision to stop breastfeeding so their hormones can get back to normal. I hate to give up, but I feel horrible and that benefits no one. No depression, just can't relax and am constantly worrying. Any advice other then from boobie nazis would be appreciated.