Will my milk supply increase if I only pump exclusively pump??

I’ve nursed my baby for the first 2.5 weeks. In the hospital he would latch perfectly fine onto both nipples. Since then he only likes to latch onto my right nipple which produces less milk than my left. I would pump my left and have him nurse on my right. He would still be hungry so I bottlefed him some what I pumped from the right breast. At night I would only bottle feed him with breast milk so my husband could help with night feedings. Now my baby is a month old and I’ve had to supplement formula because I’m not producing any milk. I’m only pumping about 1-2 ounces combined from both breasts. SUGGESTIONS??😩 I’m getting really discouraged and thinking about just stopping breastfeeding and just doing formula.