Short Lutheran phase ?

When counting days of LP should I also count the days where I’m spotting ? I usually get brown spotting 2-3 days before AF really start. I’m worried this might make it difficult for me to conceive ? 😢