Can low sperm count cause birth defects? My husband was just prescribed to clomid for low T and sperm count. This will be the first time i will take clomid and he just started it too. I'm afraid IF i get pregnant the baby will have problems becuase his sperm is not healthy or strong enough Yet. You think it could be true?