What happens when you follow someone?

When someone follows you, what happens? Can they see your posts even with your profile on private? What's the point in following someone?