midwives/healthcare visitors fear of cats

Midwife & healthcare visit fear of cats - my new pet hate! I have had a few home visits and as soon as my cat has been spotted I get the "don't leave the baby unattended with the baby, have you read the stories? Smothering can happen!" I was raised with cats, so will my child. Precautions are always taken, plus my cat is more dog like! Has anyone else had the same warning rammed down their throat? Or through their pregnancy asked if they would rehome their cat because of "risks" involved?