Inconsistent periods

I've been off birth control since March now (the pill) and my doctor told me my periods should go back to normal the very next month, which used to be so bad I couldn't stand them. Well we have been ttc ever since I went off. My periods have been super light, pretty much just spotting except for last month where I had like one day of a normalish period. This month I am currently 5 days late. I'm kinda confused on what's going on. Is this something I should be concerned about?