Q- is it neglectful to not hold baby when you are able to?

Ok so my son is 3 months and a few days old. He is able to self entertain in a swing or in a baby play gym while I catch up on chores or pump. However, when I'm not busy doing something and am just sitting on the couch on the phone or just relaxing- I feel guilty that I'm not playing with him or holding him. Is it actually neglectful not to play with him or hold him if I'm able to and he's been left there for a while? I always pick him up if he starts sounding upset or if he cries