Conceiving after birth control?

I have been off of birth control for over a year and my husband and I have been actively trying to conceive but with no luck. I first had mirena but it caused a lot of pain after 2 1/2 years and I had to have it removed, than I tried the pill for about a year than depo for the last year. Now I'm a year with no birth control and I'm afraid because of the issues I had on them it may have hindered my chances of getting pregnant. I have a child already so I know I'm capable of conceiving. Anyone else have problems getting pregnant after being on birth control?