Trouble conceiving

Has anyone else has trouble conceiving after getting off birth control? I've been on 2 different types of BC since I had my first daughter (She's 6 and the first BC was Implanon and from then on I was on Depo Provera. I stopped taking the depo shot November of 2016 and it seems like it's never going to happen. I know it may take awhile for it to come out of my system, but I missed a shot two years ago and got pregnant in college by a boyfriend (I aborted) Does anyone have any advice? My husband and I have been trying since I got off BC and I've been late a couple times....it's just tiring getting my hopes up.