Baby smell milk?

Tesla

My son is six months old and breastfed. When my fiancé has him and is trying to get him to sleep he will let him hold him and pat his back and he calms right down and goes to sleep. But he will absolutely not let me do anything or be calm unless he is on my boob. He will literally be crying and inconsolable until i put him on my boob and he will just latch and then fall asleep without even eating. He won’t take a binky for me, but at daycare he takes a binky when he sleeps. If I’m holding him he pretty much just acts upset until I let him latch. Do you think he can smell my milk? I’m just not sure what else it could be.. anybody have any other ideas?