Been off the implant for 2years.

I wondered if anyone can help and let me know if I should be concerned.
I had the implant removed 2years ago with the agreement of my fiancé as I was having terrible mood swings and I put on over 4stones.  We have both decided we are happy together and if we concieved then that would be a blessing. 
It has now been 2years since then and although the first year and half we weren't trying as such I'm still wondering if I should be concerned and if so would you recommend I get both of our fertility checked out or am a worrying for no reason? 
Thanks