How to properly stimulate baby?

Kat • Happy mother to first child on 7/7/15.
LO is 3 weeks old tomorrow, since birth he has been pretty alert and every day he's more and more alert, curious and strong. The past couple of days he seems impatient or irritable because he's trying to look around and climb me to look over my head but after ten minutes his neck gets tired and he slumps down crying. I put him in a bouncer a few times a day and give him a toy or put him on his activity mat. He enjoys these things, or at least he seems to. What else can I do for stimulation? Any good books or resources for a FTM?