Help, needing advice x

My husband and I have been trying for our first baby for 1.5yrs. We had two miscarriages last year. I had surgery in March to remove 2x endometriomas and found stage 3-4 endometriosis, some of the endo was removed but some of the more severe endo left behind.

Two months after surgery we saw a fertility specialist who recommended trying a few months of letrozole monitored cycles then if not pregnant go to ivf.

I just had my first follicle scan on the letrozole cycle, and they found I have a 4cmx4cm endometrioma that has rapidly grown back on my right ovary in less than 3 months :(

My fertility specialist rang me after and has recommended a total change in plan. He said the endo/endometrioma situation is worse than originally thought and he is now recommending we do ivf to try get some embryos in the freezer then go in for another surgery for him to completely remove the endometrioma (likely will need to remove my right ovary) and remove all the endo that wasn’t removed last time. Then after recovery surgery can try transferring the embryo.

Has anyone been through anything similar? I feel like everything is changing so quickly and I have no idea what the right thing to do is.

Any advice would be so appreciated x