Accepting Things

So I need some advice mommas, me and my SO is about to reach our 2 year mark and we are now expecting his first child. I have a little girl already she’s 3 so this will be his first child. Now when me and him first started dating him and my little girl relationship wasn’t the best, he didn’t play with her, he didn’t really create a bond with her, when he did play with her it was more so of passing licks and I didn’t like it because as a girl she would cry and get upset sometimes. Over the past year I’ve learned from his childhood and from his mother he never was showed affection, he never had a family bonding he only had a bond with his parents more so through money. So he’s slowly learning and he does some things to show effort but he still gets irritated with a lot of thing she does and I have to remind him she’s only 3. I also tell him the same exact thing is going to happen when he has his own child it’s just apart of being a kid and that he needs patience so he’s slowing learning these things. Am I doing the right thing? Am I crazy for staying with him through this process let alone having a baby with him? Any opinions?