I just need advise

So my fiancé everyday after work goes and meets up with his friends. It takes about 40 minutes to get back into town after work. He gets off at 8pm he doesn't get into town let's just say about 8:40. The minute he's back in town he goes straight to meet up with his friends and hang out. He doesn't come in the house until 11:00 or 11:30pm. He leaves in the morning our daughter and I are sleep. On his days off he spend the whole day out with his friends I feel so alone and our daughter gets so upset when he has to work because she wants him around. I told him numerous times how I feel and all I get is "am I that bad of a father". I don't think he's cheating. I just want advise ladies because some times I'm just ready to pack and leave