Can barely put him down

My son will be 2 months old on the 18th... when he was first born I did kind of hold him pretty often. Now when I try to put him in his swing,boppy, or rocker he will stay in it 10-15 min max before he starts crying and wants picked up. I don’t want to just let him cry it out bc he will just start screaming. I’m not saying I don’t want to hold him it’s just hard to get anything done when he constantly wants held. Is there anything I can try to get him to stay in something longer?