my partner gets annoyed... :/

Because I can settle our 7 week old daughter when she's upset. He works 4 days a week atm and goes in the morning at like 10;30 and comes home around 11:30 at night. He gets really annoyed and sorta upset because when he was home when she was born for about a month he was the only one that could settle her mostly for the first week.
Not really sure what to do? I can't help the bond me and my daughter share already but I hate him thinking she doesn't like him.