Should I worry about infertility problems yet?

I have had 2 previous children. I gave birth going on 9 months ago. I've been ttc for the last 7 months, going on 8! I have very irregular periods, and my BBT's are all over the place! First two pregnancies happened quickly, should I start to worry? I got pregnant fast after first pregnancy, but could my body still be recovering from having baby #2? So worried and upset, trying not to be but its hard!