ECE 6617 Information and Coding Theory

Credit Hours: 3 semester credit hours

Area of Specialization: IS/Information Security

Prerequisites: Probability Theory & Communication System Basics

Course Outline: The course forms the basis for evaluation & analysis of modern Information & Communications (wired/ wireless) Systems. Information theory deals with representation of information for efficient storage & transmission. It provides information measurement & quantification framework to determine the limits on information compression & channel capacity. Coding theory deals with the issues of protection of data while passing through hostile environment. It deals with techniques (Error control codes) that add enough redundancy in data to protect the information bits without overloading the system. The course has been designed to strike a balance between required mathematics & its application to information & Communication systems.

Course Contents: Overview of Digital Communication System & its relationship with the contents of the

course. Related Probability theory concepts: addition rule, Conditional, Joint & Total probability, Bayes rule, Sum & average value.

Discrete Sources and Entropy: Information Entropy, Shannon’s Source Coding Theorem, Huffman Coding, Lempel-Ziv Coding.

Channels and Channel Capacity: Discrete Memoryless Channel, Binary Symmetric Channel, Shannon’s Channel Coding Theorem, Sources with Memory and Markov Processes.

Constrained Channels, Data-translation Codes, (d,k) sequences, Run-length Limited Codes, DC-Free Codes

Channel Codes: Binary Fields and Vector Spaces, Linear Block Codes, Generation & Testing, Decoder implementation, Error Rate, Performance Bounds. Hamming Codes.

Cyclic Codes: polynomial representation, systematic cyclic codes, Generation and Decoding. BCH Codes

Convolution Codes: structural properties, encoder representations, Viterbi Decoder Algorithm, Hard vs soft-decision decoder, Trace-back Method, Systematic & non systematic

Reed-Solomon code, Interleave & Concatenated codes, Turbo codes, Trellis Coded Modulation (TCM)

Information Theory and Cryptography: Language Entropy & Ciphertext Attacks, Perfect security, Diffusion & Confusion, Cipher Systems performance quantification

Suggested Text Applied Coding and Information Theory for Engineers” by Richard B. Wells Digital Communications: Fundamentals & Applications (2nd ed) by Sklar & Ray Information Theory, Coding & Cryptography (2nd Ed) by Ranjan Bose