condom makes hubby go limp

We are TTA and I am not a fan of birth control. Every time my husband puts a condom on he gets soft and cant get hard again. The sex has never been great either. Any tips?