4 days PP and breastfeeding is killing me

I feel so guilty that it is so painful when my baby boy latches. He's got a great latch and I've got a great supply so far but the bleeding nipples and soreness is so difficult I dread feeding my baby.
I think I want to begin pumping and bottle feeding him so he still gets my milk. Has anyone else done this when their babies were just days old? What was your experience?