Should I be concerned?

I'm 27 and have been off the contraceptive pill for over a year. I am happily married and we are not actively ttc, but aren't using any contraception. I know there is no fertility issue with either of us as I have been pregnant before. 
Should I be worried that it hasn't happened yet?