Pumping breast milk! Advice please!

Alexis • 25, momma to a little boy, 3 years old, diagnosed with Angelman Syndrome in Nov. 2017, living life to the fullest! 💙 11th cycle TTC baby #2! 💝
Since I wasn't able to breastfeed my little one due to him not latching I've been pumping and giving it to him in a bottle. He will be 3 weeks tomorrow. I'm glad I can give him my milk this way but pumping all the time is starting to make me very irritable and angry. I feel like all I do is pump or worry about when I have to pump next. I want to stop all together and just do formula so I can bond more with my little guy but I feel so guilty 😔 I don't know what to do! Advice please!