Trouble getting pregnant

I'm 25 and my husband and I were planning on waiting two years TTC. After being on here, I see how common it is to have problems or it taking awhile to get pregnant. Should we try sooner? I've never been on birth control and my AF has only been irregular 3 times since I was 14. I'm just worried I'll have problems getting pregnant.