ttc and ignorant friends and family...

I'm sure I'm not alone here but my husband and I have been ttc for roughly 2 years and lately I've been getting a lot of comments from friends and family saying "just relax and it'll happen when you least expect it" or "your just too stressed, stop stressing and it'll happen". I always just smile and nod but I think if I get another comment like that I will throat punch someone! I don't wanna be mean about it because I know they mean well but I can't just keep listening to these comments. So how do you ladies handle these types of comments from friends and family? Should I say something? Or just keep it to myself because they don't know any better?