Baby after contraception.

How long after you stopped taking contraception did you conceive a baby? I've been told the longer you were on contraception the longer it will take to fall pregnant. Is this true??