low milk supply

When my son was born, he was immediately taken to the nicu due to swallowing meconium. they also started him on a bottle before I could even make it down there, even when I expressed that I wanted to breastfeed. Well he got used to the bottle & would always get so frustrated with latching onto my breast that I just started pumping & would put it into a bottle for him. he is 4 weeks old today & no matter what I do, I can't produce enough to keep up with him. I pump every 2-3 hours, I've taken fenugreek & drink lactation tea. my right breast is almost dry (only puts out about 1/4 of an ounce at each pump session) and my left breast is down to maybe a half ounce. I also take levothyroxine for my underactive thyroid. has anyone else had this problem? if so, what did you do to fix it or did your body just make you give up like mine is trying to do?