Fundamental concepts of information theory, Entropy, Kullback-Leibler divergence, Mutual information; typical sequences and their applications, Loss-less data compression, Huffman codes, Elias Codes, Arithmetic Codes, Discrete Memory-less Channels, Channel Coding and Capacity, Differential...