Ovulating late

Jennifer • Mom to Baby #1 born 8-2-16. Actively trying for Baby #2!
Well after 10 days of OPKs I finally got a surge. Today is CD 16 meaning I should ovulate tomorrow on CD 17. This is my first month doing an OPK so I'm not sure if this is the norm but if it is it explains why I'm not pregnant yet because my fertile week is actually a week later than we thought! However, I'm concerned that I'm ovulating late in a short cycle. My cycles are only 23-25 days. Anyone have this problem? I read that a short luteral phase can be the reason for infertility and / or miscarriages. Should I be concerned?