TTC shaming??

I'm 31 and got married in September 2014. We have been together for over 3 years and are very happy together.

I told my sister in law and a few people at work that we're officially TTC and I feel like people make comments that sure seem like they're trying to get you to reconsider. It's not like I'm single or 15 or don't have my shit together...we own a beautiful home, both make good money, I'm working towards a promotion within my corporate job. Anyone else dealt with this??