Baby refusing food

has anyone else's newborn had serious eating troubles? I can't get my two week old to eat more than an oz at a time. He either falls asleep or cries. I'm seeing a BF consultant and we are taking a few days off the boob to bottle feed and try and get his weight up but when it takes 30mins-2hrs to get him to eat and an hour or so to pump 2oz I'm having a hard time. We have tried stripping him down, rubbing him and tickling him to keep him awake but it doesn't really help. what else can I do? I'm losing my sanity and my breast milk supply..