Breastfeeding while pregnant

I just found out I'm about 8 weeks pregnant. I had noticed a drop in supply over the past few weeks which is one reason I tested. My question is this... how do I (or does it get better) get past the extreme nipple soreness? My son is 8.5 months old so I don't want to wean him yet but the pain is horrible! also he just got 6 teeth in two weeks ago so it has been worse than I expected it would be. He doesn't bite, just normal nursing but those top teeth are sharp!