Secondary (in)fertility.

Hey girls. Seems the more research I do the more I worry. I got pregnant with my first baby at 31. He will be 2 this May. I've been pretty much trying to get pregnant since last summer with no success :(. I've used the fertility sticks to track my ovulation but I'm still not pregnant. Often it seems that infertility is not a thought if you've already had a baby before but I've been reading about secondary infertility. Have you experienced this? Anyone struggling to concieve their second baby? If so, why do think that is? Is it your age, your weight, your husband's age or weight, smoking, etc? I finally made the decision to see a fertility clinic my next cycle because I am so worried at this point that it's all I can think about.