Do you have to take Iron supplement on an empty stomach?

EM

I'm taking Slow Fe. One doctor told me to take on an empty stomach and another doctor told me didn't really matter. Just wondering if anyone was told specific instructions?