Luteal phase spotting , please help 😭

Hey girls , so this is super frustrating! I had an hsg early May this year and had luteal phase spotting at 7dpo that same cycle, but no pregnancy. Conceived in the next cycle in June, no spotting but lost it at 5 weeks ( I think do to some misguided medical treatment from ob) . Next few cycles more of the same beige discharge in my luteal phase. It's only light beige and only shows for a few hours on one day. I've had a few progesterone tests done and they've all been good. Anyone with any insight , I'm losing hope of conceiving again 💔😭