When can you stop worrying about miscarrying?

I'm 11 weeks. When can I stop worrying about miscarrying? I've heard the closer to 12 weeks the better off you are? I only really hear about people miscarrying 10weeks and under.