Stress impact on baby

I've had a really hard time with hormones and have had a lot of stress and depression. Work has been very difficult and the pregnancy has, as it always does, caused many changes and emotions.  How much does this impact the baby? We're really concerned that it will have problems or be damaged by all this. Any thoughts or experience with this?