Confused??

Linsey
Well, to start I had my first child at 20 weeks 3 years ago. Was on depo until March of this year and then took the pill for a month. After taking the pill my AF was completely normal and has been up until last month. I had 3 AF all in October and this month, only one. My fiance and I have been trying since April and we try during every fertile window and also days that I'm not, just in case. Could the depo have caused me to be infertile? Or just need to keep trying?