PCOS & low sperm count

Hey everyone! Just wanted some opinions.. my husband and I were trying for a year and now went to a fertility doc and I've been diagnosed with PCOS and they say he has a low sperm count. It seems as though the doctor is pushing for us to head straight to IUI but I feel like maybe there's something else we can try in between? I know if his sperm count was good they would probably put me on clomid or metformin but is there anything that can help a low sperm count? Has anyone else had a similar situation? I'm really stressing myself out thinking about IUI and then if that doesn't work IVF...