How long do you let baby fuss?

In the middle of the night how long do you let baby cry/whine before comforting them?