High stress

I work in a VERY high stress job. My pregnancy has also brought on some strong hormones it seems and the mix of the two is causing some serious anxiety. It's not just general work stress it's like heart racing sweating, panic attacks. I've talk to my doctor who had me take a week off to see how it went, it helped tremendously. I went to another appt and he asked what I do and I explained and explained what happens and how my body has been reacting since I've Been pregnant. I asked if high levels of stress and anxiety (almost constant) is going to hurt baby in any way and he said since I'm past my first trimester (I have a history of 5 losses) that it's fine and isn't harmful in any way. Is this true??? I just don't see how this level is stress and anxiety is safe? I also am seeing a cardiologist about my heart issues because I've tried everything to help this and it's not doing anything :(