Should I stop pumping

My baby had serious latching issues at birth and after 3 days of crying, screaming, and refusing the boob, we made the decision to switch him to formula. Since then I've been pumping, but since my supply was never well established, I've never made much milk. He's 5 weeks old and I'm only producing about 4 or 5 oz a day when he eats about 25oz in a day. I probably could make more milk if I worked really hard and commited myself to pumping more and increasing my supply, but I don't feel like I have the time or energy to invest in that. So with that being said, I'm considering quitting and strictly formula feeding. I'm having a hard time bringing myself to make that decision out of pure mommy guilt. I feel like a little breastmilk is better than none, but he's barely getting any at all so what's the point? Should I stop pumping and get rid of the hassle and inconvenience, or try harder to get what milk I can?