Should I keep trying ?

My baby won’t suck for more than a few seconds while trying to breast feed, he’s had a bottle up until now and he’s almost 3 weeks. I’ve been trying to latch him but he just gets so frustrated that I don’t want to upset him and I stop trying. I’m also only producing 1 ounce every 2 hours which is definitely not enough for him as he takes about 2 every 2 hours.

Can someone please give me any advice or encouragement? Or should I stop? Maybe it’s too late?