TTC length

How long after trying to get pregnant should you start worrying there's something wrong? What's the average time it normally takes?