Allergic to latex ... need help!!

What if a guy says he’s allergic to latex what do I say do I say no I don’t want to have sex(btw I’m not taking birth control right now) or should we just try the non latex condoms well my question is ...is there a higher risk of getting pregnant with a non latex condom ...do they break easy