Been off birth control one week, been on it for about 3 years..

I stopped birth control bc me and my husband really would love to have a baby. Is it possible for me to get pregnant soon or will it be harder since I've been on the pill? Any advice is appreciated