When did you know it was time for a divorce ?

My husband and I been together for 4 years going on 5 , 1 year married in July but For a while I just feel like our relationship isn’t going anywhere.

Taking these days just doesn’t get us anywhere. He barely touches me, and I’m honestly afraid of leaving him alone with our baby girl because he gets so frustrated at her for simple things like crying. I want to try therapy first but wanted to know if anyone could relate