Hair dye

I had my hair colored today. Natural brown color to cover up highlights. I feel like the smell is still strong and my baby might not like it. Does anyone know if I can wash, or at least rinse and conditioner, it? Or do I need to let the color set more?