Stopping progesterone

Nicola

So I'm taking progesterone for luteal phase deficiency. When I stopped last cycle due to negative pregnancy test, my period came a few days later. This time I'm Day 5 and still nothing. Should I be concerned? I hate how progesterone delays period when all I want is a period so I can start my baseline and move forward. Feeling anxious and frustrated.