Moving on to IVF

Well, I've reached a crossroads in this whole journey. After a year of trying and one failed clomid+IUI cycle, I got a second opinion last week. The new doctor (who is widely loved and respected) is concerned I have low ovarian reserve/an egg quality issue based on my labs (AMH and day 3 estrogen). He's recommending that we move to IVF right away or else he cautions that if we want to have a second child (trying for our first now), it might be virtually impossible by then. I'm worried about the cost and stress of IVF, but I'm also so tired of trying and trying with no luck. Has anyone been in a similar situation?  I'd welcome your thoughts. Thanks!