lecture11: Coding Language

Topics covered

• Redundancy
• Redundancy in English
• Entropy, Redundancy and Compression
• Letters and numbers
• ASCII
• ASCII in detail
• ASCII art
• English
• Upper Bound on Optimal Codes
• Block encoding
• Stochastic Process
• Stationarity
• Markov Chains
• Transition Matrix
• Some more definitions
• Markov Chain Results
• Stationary Distribution
• Higher Order Markov Chains
• Markov Chains for Letters
• Entropy for Markov Chains