Nipples and breast

Lo will be 4 weeks tomorrow and different times of the day my nipples and breast will start burning out of nowhere for a few seconds then stop. Anyone else have this?? Im trying to get my milk supply up so the past fee days been drinking mothers milk tea and eating lactation bites as well as putting baby on the breast and pumping but i dont know if my supply has increased. Her stools are now yellow and seedy again but after she is on the boob forever i still have to give a bottle after. My nipples are so soar but no rips or scabs. Any advice????