Had Depo shot & 2yrs later no pregnancy

I had my last depo shot in 2013. I still have not conceived. 
Should I be concerned?
I'm 25 with one one child. 
I am going to my gynecologist Monday. Should I see if she will refer me to a fertility doctor?