not nursing

For the past two days my LO spends most of the day only nursing for 4-5 minutes before getting mad and wanting to sit up. Last night it took me four hours to get him to sleep because he kept waking up fussing. 
 He's been super fussy and just finished antibiotics for an ear infection this past week. He's not grabbing his ears like he did at the beginning of the ear infection so I don't think that's the issue anymore. 
Any tips? Anyone gone through this?