Loading

Module 1: Inequalities in Information Theory

Notes
Study Reminders
Support
Text Version

Inequalities in Information Theory - Lesson Summary

Set your study reminders

We will email you at these times to remind you to study.
  • Monday

    -

    7am

    +

    Tuesday

    -

    7am

    +

    Wednesday

    -

    7am

    +

    Thursday

    -

    7am

    +

    Friday

    -

    7am

    +

    Saturday

    -

    7am

    +

    Sunday

    -

    7am

    +

Data Processing Inequality
The data processing inequality is a concept that can be expressed concisely as post-processing cannot increase information.
Fano's Inequality
Fano's inequality gives a lower bound for the probability of error for m-ary hypothesis testing problem.
Variation Formulae
Variation formulae for information theory quantities in recent years become important for both theoretical as well as practical reasons. There are numerous ways of the application of variational formulae, such as:
• Information radius interpretation of capacity,
• Pinsker's inequality,
• Continuity of entropy.