HELP!

Here's the back ground. 

Together for over a year baby unplanned but we were over the moon, my family interfered and pushed him out, due to his background he struggled to show emotion and came across as controlling leading me to end up doing emotional abuse work, but I strongly feel it was circumstance that caused the issues and we didn't know how to work through them. When we split it was stupid but then I found a lot of messages to women looking for attention which he majorly regrets. I wasn't an angel. But now there's a lot of people telling me I can't ever go back to him because of his problems. I love the man and I want my family back. I want to give him a year, to prove himself as a dad and get mediation to form better communication and work through our problems. But am I stupid wanting him back? Is it wrong to still want him after being hurt so bad? He's the only person I have passion for, I've not slept with anyone else and he's the only one that brings those feelings. Nobody would accept me going back to him that's why I'd take so long before I decided it's still early days but I know I want to fix things but I don't want to lose the little family I have for the sake of having my own family back together.