when do you just give up?!

I have been having issues breast feeding since practically day one. First my daughter didn't want to latch and now that she latches my supply plummeted then I got my supply to just enough to nurse her and that's it but now I can't pump to save my life. I have been trying to make this work for 7 weeks. I've been stressed out and cry almost daily. When do you just throw in the towel and accept you can't breast feed?m because I can't see mm to bring my self to quit but I can't keep living stressed out either.