Goes soft with condom

Help! My S/O goes soft almost every time he puts on a condom and we end up having unprotected sex because it won't work otherwise, is there something that I can do that might help this!!? Is it normal to go soft with a condom on??