Sex with no birth control...

I've recently got married and stopped taking the pill about a year ago and I haven't gotten pregnant yet when is it time to start worrying that I can't have babies?