Having a cat and trying to conceive

I have a cat I had have him for about 3 years now, but now I want to have a baby and so many people keep telling me that the hair of cats are bad that make women sterile. I have search on the internet and you see different versions. I would like to know what you all think and what’s your advice.