Painting while preggo?

I asked my doctor if I could paint while pregnant and she said I could help but not do most of the painting. I was ready to go but noticed the back of the paint labels stating it could cause birth defects due to a chemical known to in California. My husband read this and immediately told me he wouldn't chance me painting. What are your thoughts and experiences?