Advice!!

So I should start this by saying I’ve already gone to the doctor, I’ve asked hundreds of times about it. But here’s my issue. So I started having AF at 16, had 2 regular ones and then got on BC since I was sexually active. I had a few periods here and there but then got off of it because it was making my depression worse. Well I would get my period maybe 3 times a year and that’s it. Last year I had one in January, February, March, and then December all at different times of the month. My SO and I are ttc and it’s hard to tell if I’m ovulating and when I am. My doctor just keeps telling me “well you’ve always been irregular so it’s fine” even though I’m pretty sure only having AF maybe 3-4x a year isn’t good. Just wondering if anyone’s dealt with this before or has any advice? Really hoping to get a BFP this year 💕