Bad dad/good SO??

Does anyone ever worry that their SO isnt/wont ever be a good dad? We have a beautiful 10 week old baby that wasnt planned (i was on the pill) but we were still blessed with, i knew he wasnt ready but we talked about it and that was that. I became a mom when i found out i was pregnant but he didnt become a dad at the same time. I thought maybe when he saw the ultrasound, it would just click with him, it didn't. Maybe when he saw my body change and felt her move and kick, it didnt, then i figured that it would definitely click when she was born and he could finally hold her but it still didnt click. He has told me that he really doesnt think about her and he knows that he doesnt care about her the same way i do. I try to get him to spend time with her but he always gets so frustrated with her and ends up in a bad mood and just hands her off to me because "she only calms down for me". Our relationship is going through a rough patch to say the least. His lack of a bond with our daughter is making me more and more distant with him. Im just afraid that he wont ever "become" a dad and i dont think i can be with a man like that. He provides for us financially but i need more than that, any man can father a baby but not just anyone can be a dad. I truly loved him before she was born and i know that i still do but sometimes i feel like i love him a little less each day. Can anyone understand what im going through? Any advice besides talking to him about it? Because we have, just not in so many words. Should i just try to get over it? We never really had problems before this and even now we dont really have too many arguments or fights but i feel myself resenting the fact that he isnt trying to bond with her.