Information Theory
Books, Lecture Notes
- Elements of Information Theory, T.M. Cover and J.A. Thomas.
- Information Theory, Inference and Learning Algorithms, David J.C. MacKay.
- Modern Coding Theory, A. Montanari and R. Urbanke
Courses
- CMU
- 10-704: Information Processing and Learning (Spring 2012)
- MacKay: Course on Information Theory, Pattern Recognition, and Neural Networks
Posts
Papers
- Peter Grunwald, Paul Vitany: Shannon Information and Kolmogorov Complexity (2010)