Catscans and trying to get pregnant

So i have had multiple catscans over the course of a few years as i suffer with kidney stones. I heard that too many can affect trying to conceive.. I saw my gyno and he is not an OB but says i should be able to concieve.. Any input? Thank you :)