Fundamental concepts of information theory, Entropy, Kullback-Leibler divergence, Mutual information; typical sequences and their applications, Loss-less data compression, Huffman codes, Elias Codes, Arithmetic Codes, Discrete Memory-less Channels, Channel Coding and Capacity, Differential Entropy, Gaussian Channels, rate distortion theory, Multi-user Information Theory, Connections between information theory and statistics.