Cancelled IUI...again

My husband and I started seeing a fertility specialist a few months ago. I have only 1 tube which came back clear from the hsg. Husband has some sperm issues and i was diagnosed with pcos. I originally went in asking for clomid but due to the risks he pushed letrozole. Thats fine. I began 2.5 mg letrozole for 5 days and went in for a scan and had a follicle on each side measuring only 6mm each. They put me on another 5 days of 2.5 letrozole in hopes that my right ovary (the side with a tube) will grow. Went back in for another scan and my left ovary was the one that grew an 18mm so <a href="https://glowing.com/glow-fertility-program">IUI</a> was cancelled since I dont have a tube on the left side. I of course got frustrated and asked for 5mg of letrozole and the dr agreed. I thought well obviously the left side doesnt matter (thats what the dr said bc its very rare for one tube to catch the egg on the other side) so maybe this would get me juicy eggs on both sides and we can try an <a href="https://glowing.com/glow-fertility-program">IUI</a>. So i took 5mg letrozole for 5 days the next cycle and had 2 eggs on both sides. Left side was 16 and 11mm and right side was 14 and 10 mm. They said that the 14 on the right side "looked more like a 16 upon closer examination of the scan". They wanted me to trigger and have the <a href="https://glowing.com/glow-fertility-program">IUI</a> done in 2 days. I said no because i dont feel comfortable triggering with a 16mm. They said to come back in a couple days to see if they grew and they did not grow at all. They stayed at 16mm. I told the doctor that we need to take a more aggressive approach because Im not even getting a chance to have an <a href="https://glowing.com/glow-fertility-program">IUI</a> with what were doing right now.

The reason why he was against clomid is because he said that it increases the chance of multiples which is dangerous. He gave a few examples of his last few patients who got pregnant on clomid and 1 set of twins both died. 1 twin died during another delivery and 1 twin from another delivery ended up with serious defects.

Has this happened to anyone else where they were just unable to go through with the <a href="https://glowing.com/glow-fertility-program">IUI</a> because they couldnt get the eggs? If so what did the doctor recommend? My amh is 10.89 and I asked the doctor if this number could appear higher because of the pcos and he said yes. I asked him what my fsh was and i guess he wasnt at his office so he couldnt tell me but I still have no clue what my fsh is. Could it be my egg quality? How could my eggs just stop growing like that? Im sorry for the long post and if you read this far thank you!