Slowly losing my sanity breastfeeding

While I was pregnant, I had my heart set on breastfeeding. Everyone doubted me and basically said I'd give up. He is almost 3 weeks now and breastfeeding is making me go crazy.. I get no sleep, his constant cluster feeds make my nipples hurt so bad, he's super fussy before, during, and after feeding. He's gaining weight so that's not a problem. Does it get better? I really don't want t give up