Trying to conceive

Why is it that people who don’t try to conceive get pregnant super easy. But when someone that wants to have a baby can’t... or has the hardest time trying.. It’s stressing me out.