Trouble getting pregnant after using the Mirena??

Heather

September 2014 I received the Mirena after having my first child. I got the Mirena taken out in March 2018, I am with a different man (the love of my life) and we’ve been trying ever since and I still have yet to get pregnant. He thinks it’s him but I think it’s me due to having the Mirena for so long... is anyone else having these issues? After getting the Mirena out my menstrual cycle came back like normal, I’m loosing hope thinking the Mirena has done something to my body for me not to have children again!!