Boyfriend making me feel bad for wanting to stop breastfeeding

I’ve been breastfeeding and pumping for our son for 3 weeks now and mentally it’s starting to wear on me. From getting mastitis to having to feed him every hour and a half, I’m literally losing my mind. I don’t know if I just don’t produce enough for his appetite but he’s constantly eating and my nipples are SO SORE. And pumping all the time, especially throughout the night, is so time consuming and difficult. I have a freezer stash so baby will still have breast milk for a while, but my boyfriend thinks I’m selfish for wanting to stop. Anyone going through the same thing or have any advice?