Need advice people

Me and my partner want to start our own family but he is scared of what happened before with his ex as social were involed with her. She endes up losing his child but he wants to try with me but he is scared that it's going to happen again when he knows it isn't how can I comfort him about this or should I drop it as he doesnt see his only child?