When is it too fast to move on?

My relationship with my baby’s father did not work out. It was constant fighting, verbal abuse from both of us i admit. Everything went downhill and we just stopped having respect for eachother. Our daughter is 2. Honestly, as a father figure he’s an amazing person. I grabbed some clothes and went to my mother’s house. Only because i realized that our situation was never going to get better. It has been 2 months already. We keep in touch because of our daughter. I love him obviously. But as a woman i also recognize that we were not good for eachother and the best thing was to move on. I have a guy friend that i’ve been knowing for a loooong time. We just started talking and he’s so lovely. He has a daughter of his own and sadly, his relationship didn’t work out either. We have been in constant communication and i feel like have gotten a lot closer. We went out once to get some drinks. Overall everything feels good with him. But when is it too fast to move on? obviously i want to get to know him better. But i feel so guilty even just by talking to him. I have a girl friend that went through the same thing and months later she found a wonderful man. And my mom made a comment last time and said that what she did was “wrong because she moved on too fast.” I just dont want to get judge..