⟩ Can you explain information theory plays an important role in field of compression
- Information Theory is about quantification of information.
- It is used in compressing data.
- Entropy is a key measure of information.
- It is expressed in terms of average number of bits that are required to store a message.
- Entropy is used to quantify the uncertainty which is a process in predicting the random variable values.
- Lossless data compression, Lossy data compression and channel coding are the fundamental topics of information theory.
