ECE 671 - Information Theory

3 credits
Prerequisites: ECE 521, 571
Fundamental aspects of information theory. Topics include discrete and differential entropy, discrete source and channel model, information rate, mutual information and channel capacity, coding theorems for sources and channels, the data processing theorem, encoding and decoding of data for transmission over noisy channels, rate distortion theory, maximum entropy distributions, and entropy estimation techniques for unknown sources. Several applications of information theory are included.