IT is a beautiful sub-field of CS with applications across the gamut of scientific fields: coding theory and communications (under unreliable channels), cryptography, physics, biomedical engineering, computer graphics, machine learning, statistics, and even gambling and stock trading. It is truly a marvelous through process.
Entropy of R.V. X is denoted by H(X)
= E[log( 1/p(X) )]
Intuition behind the formula:
Not so basic results and some applications of IT in Part 2 ..