Irregular cycles and ttc after an IUD

My husband and I have been trying to get pregnant with a second child since February, this is when I had my IUD taken out, and I've only had three cycles since. I know we haven't been ttc for long, but my cycles are averaging about 45-50 days between each cycle. I am expecting my next one by the 29th of this month if it's sticking to this routine.

Before my IUD and my first pregnancy my cycles always came at 30 days, and have always been the same length, 6 days.

We've been feeling very discouraged.. I have been taking prenatal vitamins, exercising regularly, staying away from caffeine, and testing with ovulation tests and still nothing. Has anyone else had this issue?