camomile tea

I love camomile tea! I really want a cup now because I have a cold, would really help my sore throat. I asked my doctor and he kind of danced around it, he said he doesn't recommend pregnant women to have tea at all because it's diuretic, but so is coffee and soda and I've also been told it's ok to have one cup of those. Even with that ok I don't drink coffee and if I'm craving soda I'll have ginger ale. I know some herbs aren't safe and that's what I'm worried about. So does anyone know if it's safe or not to drink camomile tea during pregnancy?