Information Theory

Information theory

• Information Theory - Khan Academy (videos)
• More about Markov processes:
  • Core Markov Text Generation - Coursera (video)
  • Core Implementing Markov Text Generation - Coursera (video)
  • Project for Markov Text Generation Walk Through - Coursera (video)

Parity & Hamming Code

• Error Correction - Khan Academy (video)
• What is Parity - Youtube (video)
• Hamming Code:
  • Error detection - Youtube (video)
  • Error correction - Youtube (video)
• Error Checking - Youtube (video)

Entropy

• Information Theory, Claude Shannon, Entropy, Redundancy, Data Compression & Bits - Youtube (video)

Cryptography

• Cryptography - Khan Academy (videos)
• Cryptography: Hash Functions - MIT 6.046 (video)
• Cryptography: Encryption - MIT 6.046 (video)

Compression

• Compression - Computerphile (video)
• Entropy in Compression - Computerphile (video)
• Upside Down Trees (Huffman Trees) - Computerphile (video)
• EXTRA BITS/TRITS - Huffman Trees - Computerphile (video)
• Elegant Compression in Text (The LZ 77 Method) - Computerphile (video)
• Text Compression Meets Probabilities - Computerphile (video)
• Compressor Head - Youtube (videos)
• Google: GZIP is not enough - Youtube (video)