Tourette Syndrome and TTC

Grace
Anyone else that has been diagnosed with Tourettes and TTC? I've been TTC for over 5 years and I hear so many times from others that maybe it's for the best that it hasn't happened yet because of my TS. I smile and brush off their comments but after years of hearing it I'm getting offended. I already have two beautiful heathy older boys why would not having another child be for the best? Am I just over reacting or are they all being rude ?