COMP2610 - Information Theory
- Units: 6
- Lectures: 26 x 1 hour
- Tutorials: 5 x 2 hour
Information theory studies the fundamental limits of the representation and transmission of information. This course provides an introduction to information theory, studying fundamental concepts such as probability, information, and entropy and examining their applications in the areas of data compression, coding, communications, pattern recognition and probabilistic inference.
The course material will be based on MacKay's book. We will cover material the first four parts of that book, roughly along the lines of the "Short Course on Information Theory" outline given at the beginning of the book. The notion and definitions from that book will be used wherever appropriate.
David MacKay's Information Theory, Inference, and Learning Algorithms, Cambridge University Press, (2003)