Hungry but fussing and rejecting bottle

Baby boy is 5 weeks

When hungry lately he will drink a little then fuss and push bottle away ... not sure what's going on, hes done this all day and seems unhappy.. thoughts?