Does it always turn physical?

I am in a very emotionally abusive relationship with my daughter's father. We have been together for 3 years and my baby is 6 months old. I'm having a very hard time leaving. It gets better, then bad, better, then worse.

I just have to know... does it always start off with emotional abuse or is it usually physical from the beginning?