Loading

Module 1: Properties of Measures of Information

Notes
Study Reminders
Support
Text Version

Properties of Measures of Information - Learning Outcomes

Set your study reminders

We will email you at these times to remind you to study.
  • Monday

    -

    7am

    +

    Tuesday

    -

    7am

    +

    Wednesday

    -

    7am

    +

    Thursday

    -

    7am

    +

    Friday

    -

    7am

    +

    Saturday

    -

    7am

    +

    Sunday

    -

    7am

    +

By the end of this module, you will be able to:
• Outline the concept of measures of information
• Discuss the differences between Shannon, joint and conditional entropies
• Describe the notion of mutual information
• Identify the basic properties of Kullback– Leibler divergence
• Explain the method of determining the total variation distance
• Describe the concept of conditional measures of information
• Explain the significance of the distribution for measures of information
• Outline the concept of chain rules
• Discuss the basic properties of measures of information related to shapes