lecture22: Error Correction Codes

Topics covered

• The basic setup
• The setup
• The fundamental questions
• Digital Communications Channels
• Example 1: Binary Symmetric Channel
• Example 2: Binary Erasure Channel
• Example 3: Non-Overlapping Output
• Example 4: Noisy Typewriter
• Example 5: $Z$ Channel
• Native ternary codes
• Channel Capacity
• Channel Capacity: Q0
• Channel Capacity: Q1
• Channel Capacity: Q2
• Channel Capacity: Q2b
• Huffman Coding Example 1
• Channel Capacity: Q2
• Prefix-free codes, and symbol probability
• Channel Capacity: Q3
• Binary Erasure Channel: Q4
• Channel Capacity: Q5
• Example: Binary Symmetric Channel
• Fano's Inequality
• Channel Capacity: Q6
• Duality