unprotected sex and no baby

I'm not exactly rushing things but I'm not exactly taking precautions either. Me and my so have been having unprotected sex for FIVE years and never have any luck with conceiving. Is this normal? Should I be concerned? Is it just gonna happen whenever it wants? I'm kinda stressed. All I want in life is children. With this man. And I just get really depressed whenever I get my period.