How do I give up ?

After a few years 5 to be exact, I have decided to stop TTC. I can’t take anymore heartbreak and disappointment. Maybe we haven’t tried long enough as many of you lovely couples out there. I’ve seen stories of couples TTC for 10+ years and they finally get their baby. How do you guys do it ? Because honestly I can’t anymore. NOT ONCE have my husband and I had a pregnancy scare. My period is always on time. We’re dealing with Male infertility and this is killing my husband, he feels like a failure. He’s the love of my life and I don’t see my life without him. If a baby is not in our future than I will accept it. We can’t possibly afford IVF that’s way too much money. How do I simply just give up ? My heart can’t take it anymore.