Fertility

Hey all! 
So I have a random question! 
My boyfriend and I aren't trying to conceive but there have been so many times when we didn't try to stop it and nothing ever happened.
We both are wondering if there's something wrong with one of us? How long has it taken you to get pregnant before? Is this normal?