Depo Shot

I took the depo for a few years and was satisfied with it. My period was gone within 2 months of use. But now I have been off of it for about 2 years and we use no form of protection but have not gotten pregnant. My gyno says that my body may still be pushing out the birth control, i just feel like by now I should have gotten pregnant. Has anyone else had concerns after taking the depo or am I just being impatient because everyone around me is getting pregnant or giving birth.