The Information (58 page)

Read The Information Online

Authors: James Gleick

Tags: #Non-Fiction

BOOK: The Information
10.09Mb size Format: txt, pdf, ePub

101
013

 
 

The telegraph operator (or theorist, or compression algorithm) must pay attention to the whole message. Nonetheless, the extra information is minimal; the message can still be compressed, wherever pattern exists. We may say it contains a redundant part and an arbitrary part.

It was Shannon who first showed that anything nonrandom in a message allows compression:

F: 101
101
0111
1011
0110
1011
1010
1110
1111
0100
1110
1101
0011
1101
110

 

Other books

Blood Spirit by Gabrielle Bisset
The Friar of Carcassonne by Stephen O'Shea
Sinner by Minx Hardbringer, Natasha Tanner
Apache Fire by Raine Cantrell
Mate Magic by Shannon Duane
Tell Me No Lies by Elizabeth Lowell