Claude Shannon Information & ENTROPY (They Get Confused)

Shannon didn’t measure meaning. he measured uncertainty. It’s not about what a message means, just how surprising it is. That’s what Shannon’s entropy really is.. a measure of surprise, not meaning.

Subscribe to Club Olympus to get access to all The Lectures :)