Should I be concerned? 😓

My daughter is definitely a mama's girl, which I love.. but since I quit my job to stay at home with her, she wants nothing to do with her daddy. Part of the reason I quit was bc he was having a hard time giving her all the care and attention she needed while still taking care of himself. But now that he doesn't HAVE to interact with her, he rarely does. They'll make faces at each other from across the room, which she likes. But last night while I was holding her she was reaching out to him and so he finally took her but she started crying and fussing immediately. He tried different positions and noises to distract her but she didn't calm down. When he gave her back to me she stopped right away and smiled 😳 I definitely think it hurt his feelings a little and I KNOW it discourages him from interacting with her. I'm just concerned that this might carry on as she gets older. How can I help them bond??? Or will she just grow out of this? It really seemed like if she could crawl she would've been crawling over to him so why did she freak out when she got to be with him? This isn't the first time either. The only times she really lets him hold her is when there are a lot of relatives (strangers to her) around. Help! I don't have a relationship with my father bc he abused me as a teenager. But even before the abuse, he wasn't around ween I was a baby/toddler (he traveled doing lighting for shows) and I never felt connected to him when he did finally reappear when I was about 5 or 6. Am I overreacting to the whole situation bc of my own issues? 😟