Depo Difficulty

I went off depo in August with the thoughts it would take my body 18 months to go back to a normal schedule. It only took me two months (at most) to return to a normal menstrual cycle again. I was on depo for about four years prior to deciding to stop the shots. I've been actively trying for a baby since then with no luck. I realize its only been a few months with no luck. I was curious if any other ladies had a difficult time conceiving after coming off birth control but more specifically the depo shot.