Coming off birth control

Hello! My husband and I finally have decided to come off birth control and try for another baby. We have a 1 1/2 year old son. I finished my whole birth control pack after my period week. I ended it and bled for a few days after wards as well. And now it’s back to normal. We have had sex almost every other day since coming off it even tho I did end up missing having sex on my ovulation day. I know it can take months before you can get pregnant (took 2 months with our son) but I’m worried about how long it will take to come off it. I have been taking birth control since I was 14 and I’m 22 now. I don’t even remember when or what happened when I came off it when we had our son. Someone please help!!