TTC after mirena removal

My boyfriend and I are TTC my first and his second child. I had the mirena for 3 years and have been on birth control for 9 years. I was wondering how long some others have had to TTC after mirena removal before you conceived?!? We have been trying for 4 months and I am kind of bummed. I'm not getting  any younger and would love to experience being pregnant and a mother!!!