Baby trouble

To

So, I have a 4 month old son, but lately we've been having some problems. I have just started going back to work, and I don't feel comfortable leaving him in daycare so I have been letting his grandma watch him during my work hours. Well, the problem is she literally holds him ALL THE TIME from the time I drop him off to the time I pick him up. Now lately when he is back with me he will scream, not cry, literally SCREAM his head off every time I set him down even if he is changed fed and etc. Soon as I pick him back up, he stops. This makes it to wear I go hours without eating or using the bathroom because I cant set him down. Does anybody have any ways to cope with this or something I can possibly do to be able to stop holding him for a little bit without him crying? Thanks, all advice is welcome!!