Breastfeeding/pumping

So I was pumping feeding bottles for babe during the day, and nursing overnight. I had may the decision to transition to formula, as I thought my milk was hurting his stomach. So for 2 days, I didn’t pump/nurse; I only hand expressed for comfort. Well I now (again) changed my mind and want to continue BF’ing… except now when I pump I’m only get 1oz from each side when I used to get 4-5oz per side. I am back to pumping around the clock. Will my milk supply go back up? Or do I have the throw in the towel?