Help ladies!!

My birth control is coming up for a new one, so I decided that I would get the implant for another 3-4 years in a couple of months. Me & my boyfriend decided in 3-4 years we should be ready to try for a baby but I have heard from a couple of people that if you’re on birth control for a while it can effect your chances on having a baby.. Did any one ever have this problem? Or did you get pregnant right when you got off of birth control? HELP PLEASE.