Introduction to Information Theory

Complexity Explorer
Online

Gratis

Informazione importanti

  • Corso
  • Online
  • Quando:
    Da definire
Descrizione

This tutorial introduces fundamental concepts in information theory. Information theory has made considerable impact in complex systems, and has in part co-evolved with complexity science. Research areas ranging from ecology and biology to aerospace and information technology have all seen benefits from the growth of information theory.

Informazione importanti
Sedi

Dove e quando

Inizio Luogo
Da definire
Online

Cosa impari in questo corso?

Logic
Maths
Probability
Information Processing
Information
Computation
Forms of Information
Formula of Information
Mutual Information
Communication C

Programma

In this tutorial, students will follow the development of information theory from bits to modern application in computing and communication. Along the way Seth Lloyd introduces valuable topics in information theory such as mutual information, boolean logic, channel capacity, and the natural relationship between information and entropy.

Lloyd coherently covers a substantial amount of material while limiting discussion of the mathematics involved. When formulas or derivations are considered, Lloyd describes the mathematics such that less advanced math students will find the tutorial accessible. Prerequisites for this tutorial are an understanding of logarithms, and at least a year of high-school algebra.

Syllabus
  1. Introduction
  2. Forms of Information
  3. Information and Probability
  4. Fundamental Formula of Information
  5. Computation and Logic: Information Processing
  6. Mutual Information
  7. Communication Capacity
  8. Shannon's Coding Theorem
  9. The Manifold Things Information Measures
  10. Homework