Sleeping issues with 4 day old

So my baby is 4 days old and sleeping all day (I know this is normal it's not the problem)  he will sleep anywhere during the day, crib, pack n play, bassinet, bouncy seat and swing and of course when your holding him.  When it comes to night time, from 12-8 he will only sleep if your holding him or laying with him.  I didn't really want to co-sleep especially this little  but it's really the only way to get him to sleep and then he sleeps 4-5 hrs unless I move him & he just screams. 
Any suggestions on how to fix that?