just came off mirena

I had my IUD taken out on the first and we were told we could start ttc right away so we did. I haven't had anything but spotting since it's been out and thought for sure I'd get my period right away. my periods are pretty irregular from endometriosis though. anyone going through something similar? when should I start to test?