"What does information really measure? It measures the uncertainty we overcome. It measures our chances of learning something we haven't yet learned."
#readingToday
"What does information really measure? It measures the uncertainty we overcome. It measures our chances of learning something we haven't yet learned. Or, more specifically: when one thing carries information about another—just as a meter reading tells us about a physical quantity, or a book tells us about a life—the amount of information it carries reflects the reduction in uncertainty about the object. The messages that resolve the greatest amount of uncertainty—that are picked from the widest range of symbols with the fairest odds—are the richest in information. But where there is perfect certainty, there is no information: there is nothing to be said."
Mind at Play: How Claude Shannon Invented the Information Age" by Jimmy Soni, Rob Goodman
Start reading this book for free:
http://a.co/b4B0yKn