Do I have to switch breasts on the same feed?

Le

My 8 day old only eats between 8 and 14 minutes on one side before falling asleep (though we have in the last day or so had him staying awake longer and a couple of times through a feed). I prefer to stay on one side. Does it matter if I switch breasts on the same feed or is every other feed okay?