Unfaithful Spouses

My husband cheated on me a month ago, we have a daughter.. I've just gotten over the stage where I was unsure if I could forgive him or not, I know now that I can because he was manipulated into the situation and we love each other so I knew we could work through this... And now he's not sure he "can be with me", he said he's sure he loves me but he was unhappy in our relationship and he's not sure he wants to stay with me and that he needs time and space to figure it out, I'm so heartbroken and mad at the same time.. I love him and can't see my life without him but I feel like this is too much to handle I feel like I shouldn't be with someone putting me through this I feel like I need to start trying to move on now rather than later but I can't do that and not only because I love him but for our daughters sake I know we need to try for her aswell but I just.. I'm not the sort of person that can give space I'm going through so much emotion at the moment I need help on how to cope with it, he just needs me to back off for a bit but I just need him to hold me at the moment.. I just feel like he's already given up, like our relationship is doomed and I'm so scared I don't know what to do...