Baby not latching at night

My little one is 6 days old and latches well. Only problem is at night this changes. Takes forever to latch and is super fussy. During the day he will feed and go down like clockwork for 3 or 4 hours at a time. Not so during the night- takes a good 3 hours to feed and then he will finally sleep. Going stir crazy from sleep deprivation!! Any advice?