eth_logo d_itet_logo isi_logo

IT I: Program

Date Topic Lecturer Location
21.09.2016 block diagram of a digital communication system; chance variable; entropy; binary entropy function; relative entropy; concave and convex function Amos Lapidoth ETZ E 9
28.09.2016 Jensen's inequality; relative entropy is nonnegative; joint entropy; conditional entropy; chain rule for entropy; mutual information; conditional mutual information Amos Lapidoth ETZ E 9
05.10.2016 chain rule for mutual information; entropy is concave; Fano's inequality; nonsingular, uniquely decodable and prefix-free codes; Kraft's inequality Amos Lapidoth ETZ E 9
12.10.2016 Kraft's inequality; source coding theorem: converse, Shannon code; mismatched source code Stefan Moser ETZ E 9
19.10.2016 Huffman code; strong and weak typicality Amos Lapidoth ETZ E 9
26.10.2016 asymptotic equipartition property (AEP); size of the weakly typical set; general source coding theorem; log-sum inequality; relative entropy is convex; I(Q,W) is convex in W; data-processing inequality for relative entropy Amos Lapidoth ETZ E 9
02.11.2016 discrete memoryless channel (DMC); achievable rate; capacity of a DMC; binary symmetric channel (BSC); binary erasure channel (BEC); weakly symmetric channels; concavity and convexity properties of I(Q,W) Amos Lapidoth ETZ E 9
09.11.2016 proof of concavity and convexity properties of I(Q,W); KKT conditions for channel capacity; conditional independence and Markov chains; data-processing inequality for mutual information; joint typicality Amos Lapidoth ETZ E 9
16.11.2016 direct part of channel coding theorem: random coding, typicality decoder, performance analysis; converse of channel coding theorem Stefan Moser ETZ E 9
23.11.2016 feedback cannot increase capacity of a DMC; source-channel separation theorem; lossy compression: average distortion, achievable rate, rate-distortion function Amos Lapidoth ETZ E 9
30.11.2016 monotonicity and convexity of rate-distortion function; converse of rate distortion theorem; strong typicality Amos Lapidoth ETZ E 9
07.12.2016 direct part of rate-distortion theorem; source-channel separation theorem with distortion Amos Lapidoth ETZ E 9
14.12.2016 review of rate-distortion theorem; Slepian-Wolf coding: converse Amos Lapidoth ETZ E 9
21.12.2016 Slepian-Wolf coding: direct part Amos Lapidoth ETZ E 9


© Signal and Information Processing Laboratory (ISI), ETH Zurich Contact Imprint