Trouble after depo shot

So I had a miscarriage several years ago the first time I got pregnant. We were only 6 weeks. I was upset naturally. Life went on and I came pregnant again around 6 months later, we went in for the first ultrasound around 12-13 weeks and there was no heartbeat, we discovered it was a molar pregnancy. I was crushed again. Doctor advised that I take the depo shot which I did and suggested that we wait at least a year before trying again. So I was on the shot and took about 3 of them and then didn’t take anymore. I fell pregnant again and this time we had a healthy baby girl in August 2011. I stayed on the shot for about 4 years after that and then decided to try the pill. I was on the pill for about 1-1.5 years and then have been completely off of everything for about a year now and we aren’t doing anything to prevent pregnancy as we’d love to have another baby but so far we’ve not had any luck. Has anyone else experienced trouble after coming off depo and the pill? Just wondering if it’s something I should seek help with or if it’s just not our time yet.