Stopping Meds Concern.

The husband and I have decided to start trying for baby #3. I'm on paraoxitene for depression and anxiety that I happened to get after having baby #1. I want to go off it for pregnancy, but I'm not sure how I will be able to handle it emotionally. I get extremely angry when I'm not on my meds and become a totally different person. I do not want to become that person. I have already lowered my dose in half (I talked to my doc first,) and those first few days we're horrible but I seem to have adjusted and I feel ok now. I'm afraid of going off it completely. Has anyone stopped taking their depression meds and how did it make you feel when you did?