Nursing woes- suggestions please!!

Tiffany
I have a small left nipple which has made latching very difficult. It's upsetting because my left breast seems to produce more milk as well... So presently have a cracked nipple due to baby not latching correctly early on. Once we established a correct latch, her nursing would soften the scabbing that had been building up to heal the crack. Last night as I nursed, baby did not fully latch and pulled entire scab off leaving- basically- a fully exposed crack. It hurt so badly!!!  
Any moms have suggestions on what to do? I've contemplated pumping until it heals fully but because of how long it took to build the initial soft-scab, I'm worried about losing my supply --- especially as I feel I am not producing to her demand just yet as it is.