| Day |
Date |
Reading
Assignment |
Topic |
Assignment |
| Tues |
01/25 |
Chapter 1 |
Course Overview |
|
| Tues | 01/27 | Chapter 2 (pp. 13-25) |
Entropy,
Relative Entropy Mutual Information |
Compute entropy
of English alphabet, etc. |
| Tues | 02/01 | SNOW DAY | ||
| Thur | 02/03 | Chapter 2 (pp. 25-35) |
Jensen's
inequality, data processing inequality |
|
| Tues | 02/08 | Chapter 2 (pp.
35-43) Chapter 3 (pp. 57-58) |
AEP | 2.5, 2.12, 2.18,
2.21, 2.29, 2,35, 2.43 (due 02/15 at the start of class) |
| Thur | 02/10 | Chapter 3 (pp.
59-64) Chapter 4 (pp. 71-74) |
AEP Entropy Rate |
|
| Tues | 02/15 | Chapter 4 (pp. 75-81) | Entropy Rate |
|
| Thur | 02/17 | Chapter 4 (pp. 81-84) | Entropy Rate
(2nd law of Thermo) |
|
| Tues | 02/22 | Chapter 4 (pp.
84-87) Chapter 5 (pp. 103-110) |
Entropy Rate
(functions of Markov) Data Compression |
3.2, 3.13, 4.2,
4.7, 4.12 |
| Thur | 02/24 | Chapter 5 (pp. 110-125) | Data Compression
(optimal codes) |
|
| Tues | 03/01 | Chapter 5 (pp. 125-130) Gallager's 1978 paper |
Huffman code Shannon-Fano-Elias code |
|
| Thur | 03/03 | Chapter 13 (pp. 440-443) | Lempel-Ziv codes | Data Compression Project |
| Tues | 03/08 | Chapter 5 wrap-up |
||
| Thur | 03/10 | PROJECT COLLABORATION | ||
| Tues | 03/15 | |||
| Thur | 03/17 | MIDTERM 1 | ||
| SPRING BREAK | ||||
| Tues | 03/29 | Chapter 7 (pp.
183-191) |
||
| Thur | 03/31 | Chapter 7 (pp. 191-199) | ||
| Tues | 04/05 | Chapter 7 (pp. 199-205) | ||
| Thur | 04/07 | Chapter 7 (pp. 205-215) | ||
| Tues | 04/12 | Chapter 7 (pp.
216-223) Chapter 8 (pp. 243-249) |
||
| Thur | 04/14 | Chapter 8 (pp.
249-256) Chapter 9 (pp. 261-264) |
7.4, 7.8, 7.13,
7.29 (due 04/21) |
|
| Tues | 04/19 | Chapter 9 (pp. 264-274) | ||
| Thur | 04/21 | Chapter 9 (pp. 274-277) | Symmetric Information Rate Project | |
| Tues | 04/26 | Chapter 10 (pp. 301-310) | ||
| Thur | 04/28 | Chapter 10 (pp. 310-318) | ||
| Tues | 05/03 | PROJECT COLLABORATION | ||
| Thur | 05/05 | Chapter 14
Overview Project discussion |
||
| Tues | 05/10 | TBD | ||
| Thur | 05/12 | TBD |