Anyone experienced going off anti depression meds for pregnancy?

Ingrid • 29, hubby and I are pregnant with baby #2 due Nov 2017!
Doc recommended I try to go off. Currently 5w2d. Been off for 2 weeks and feeing moody / easily frustrated. Could be the wacky pregnancy hormones but curious if anyone has advice!!!