I have just uploaded the beginnings of an essay on information theory to my website. You can see the essay (in its currently incomplete state) here. Information theory was first described by Claude Shannon in his groundbreaking 1948 paper, *A Mathematical Theory of Communication**.* What is particularly surprising about Shannon’s truly remarkable paper is its completeness. Not only does Shannon suggest a mathematical model for (digital) communication and information, but he produces a huge array of fundamental results for his model. It is exceptionally rare that such a complete theory comes into being so fully formed, like the birth of Athena. A decade ago, UCSD produced documentary about Shannon’s life and work, which I have posted below.

### Tags

algorithms communication complexity computational complexity cooking counterexamples cryptography dropbox emacs essays geometry hikes iPad LaTeX lectures linear algebra logic M3A M32A M32AH M32B M32BH M61 M115AH M131A M167 number theory online algorithms pedagogy physics PIC10A pictures probabilistic method probability puzzles python recipes set theory stable marriage streaming algorithms videos### Archives

- January 2017
- November 2016
- January 2016
- December 2015
- November 2015
- June 2015
- May 2015
- April 2015
- March 2015
- February 2015
- January 2015
- November 2014
- October 2014
- September 2014
- August 2014
- June 2014
- May 2014
- April 2014
- March 2014
- February 2014
- January 2014
- December 2013
- November 2013
- October 2013
- August 2013
- July 2013
- June 2013
- May 2013
- April 2013
- March 2013
- February 2013
- January 2013
- December 2012
- November 2012
- October 2012
- September 2012