So mad at myself!!!!

Should I keep breastfeeding!!!! Now strictly pumping !!!After all my hard work of getting baby boy to latch back on because he was given a pacifier at the hospital and placed under lights... I'm once again asking myself should I just formula feed to stop all this guilt I'm feeling cause I cant keep up my baby is only 7 weeks old .. I already had to supplement some of his feedings with formula cause I wasn't producing enough in the beginning .. then out of no where it felt like some one flipped a switch and boom I was pumping 4oz and baby latched back on the boob I was so happy no more formula... then last week happened I was given the mini pill for birth control ..in three days it dropped my supply to 1 oz!!! And baby eats 3 to 4oz So I have been power pumping! Not getting anything and now baby tried to feed after 20 minutes starts crying im just drying up !!!😡 mad at myself should have never taken the mini pill ...anything you can recommend to get my supply back up? ..what have you tried that has been successful for you ? thank you for all those who read my post