Pumping/breastfeeding

So I have been exclusively breastfeeding since day one. My son is 21 days old now and i had to bottle fed him Breast milk all yesterday due to him hurting my nipples. He doesn't have a deep latch at all which i have worked with but now he is pulling his head back while feeding which is causing serious pain in my nipples, a burning sensation everytime he eats. So yesterday I pumped every Two hours and the most I got was four oz at a time. I got mostly three oz. He is drinking four oz from the bottle. I really wanted to breastfeed as long as I could but not sure I can deal through this pain. How can i keep my production up with pumping? Or increase my production? I feel so bad, I love the connection of breastfeeding and I don't want to do formula:(