Trying for baby #2

So its been awhile since I was pregnant the first time my daughter is now 7. I had her when I was very young and now I'm 23 and this time I'm ready and so is my boyfriend. I was on birth control called mirena (IUD) for 4 years after I had my daughter and eventually I had it take it out due to problems I was having with it. I stopped having periods and I was put on hormones for a couple months and I've had periods for the past 4 years now. Me and my boyfriend have been trying for 5 months to have a baby. I didn't think it should take so long if your on #2. :( I'm hoping the issues I've had in the past from having the IUD isn't the reason it hasn't happened. Has anyone else had this issue or something similar?