Ovarian wedge resection

So, three years ago I had an ovarian wedge resection to treat my PCOS symptoms to try to conceive. Since that surgery I have had a regular cycle. I never conceived since the surgery and recently my periods have stopped. It’s been 84 days and two negative pregnancy tests. I’m 37 and am feeling hopeless. My husband and I were saving up for ivf but at this point I feel like maybe between my age and disappointments… is it worth it? Has anyone ever experienced something similar?