IVF male infertility

How few sperm can you have to do IVF or ICSI? We have male factor infertility and trying to figure out options.