**Date** |
**Topic** |
**Lecturer** |
**Location** |

21.09.2016 |
block diagram of a digital communication system; chance variable; entropy; binary entropy function; relative entropy; concave and convex function |
Amos Lapidoth |
ETZ E 9 |

28.09.2016 |
Jensen's inequality; relative entropy is nonnegative; joint entropy; conditional entropy; chain rule for entropy; mutual information; conditional mutual information |
Amos Lapidoth |
ETZ E 9 |

05.10.2016 |
chain rule for mutual information; entropy is concave; Fano's inequality; nonsingular, uniquely decodable and prefix-free codes; Kraft's inequality |
Amos Lapidoth |
ETZ E 9 |

12.10.2016 |
Kraft's inequality; source coding theorem: converse, Shannon code; mismatched source code |
Stefan Moser |
ETZ E 9 |

19.10.2016 |
Huffman code; strong and weak typicality |
Amos Lapidoth |
ETZ E 9 |

26.10.2016 |
asymptotic equipartition property (AEP); size of the weakly typical set; general source coding theorem; log-sum inequality; relative entropy is convex; I(Q,W) is convex in W; data-processing inequality for relative entropy |
Amos Lapidoth |
ETZ E 9 |

02.11.2016 |
discrete memoryless channel (DMC); achievable rate; capacity of a DMC; binary symmetric channel (BSC); binary erasure channel (BEC); weakly symmetric channels; concavity and convexity properties of I(Q,W) |
Amos Lapidoth |
ETZ E 9 |

09.11.2016 |
proof of concavity and convexity properties of I(Q,W); KKT conditions for channel capacity; conditional independence and Markov chains; data-processing inequality for mutual information; joint typicality |
Amos Lapidoth |
ETZ E 9 |

16.11.2016 |
direct part of channel coding theorem: random coding, typicality decoder, performance analysis; converse of channel coding theorem |
Stefan Moser |
ETZ E 9 |

23.11.2016 |
feedback cannot increase capacity of a DMC; source-channel separation theorem; lossy compression: average distortion, achievable rate, rate-distortion function |
Amos Lapidoth |
ETZ E 9 |

30.11.2016 |
monotonicity and convexity of rate-distortion function; converse of rate distortion theorem; strong typicality |
Amos Lapidoth |
ETZ E 9 |

07.12.2016 |
direct part of rate-distortion theorem; source-channel separation theorem with distortion |
Amos Lapidoth |
ETZ E 9 |

14.12.2016 |
review of rate-distortion theorem; Slepian-Wolf coding: converse |
Amos Lapidoth |
ETZ E 9 |

21.12.2016 |
Slepian-Wolf coding: direct part |
Amos Lapidoth |
ETZ E 9 |