Thyroid problems and trying to conceive

My husband and I are wanting to start trying for our first after the New Year, but I am a little worried due to my Hypothyroidism and Hashimoto's disease.  Anyone else struggle with this? How has it affected you trying to conceive? 
Thanks!