I have mild anxiety and my psychiatrist says I should wait to TTC...

My fiancé and I have been together for 1 year and have been friends for over 8 years, we have dated before in high school, went our separate ways and found each other again, we are now engaged and getting married next year :-)

I was diagnosed with mild anxiety about 1 1/2 years ago, my fiancé and I are TTC and my psychiatrist says that we are rushing and need to wait because of my anxiety disorder and how it can have a negative affect on the baby. Well, I barely have panic attacks now and have been doing very well as far as anxiety goes, so I don't understand why she would say this and put me on medication that is safe for pregnancy. :-/ Advice? Opinions? Anyone having the same problem??