Fertility window part 2

Regarding my fertility window question, people say "there's always a chance of getting pregnant". also, after the fertility window ends, wouldn't the egg still be down there since you haven't had your period yet and still have a good chance of getting pregnant?