Information Theory

Numbering Code U-ENG26 26013 LJ72 Year/Term 2022 ・ Second semester
Number of Credits 2 Course Type Lecture
Target Year Target Student
Language Japanese Day/Period Tue.1
Instructor name YAMAMOTO KOUJI (Graduate School of Informatics Associate Professor)
Outline and Purpose of the Course This course discusses information storage (compression), and basic issues related to information transmission, especially information source coding and communication channel coding. Lectures also describe concrete error detection codes (cyclic codes, etc.) and error correction codes. The ABCs of information security are also touched upon.
Course Goals Students will grasp basic concepts concerning information storage (compression) and transmission. They will also understand concrete error detection codes and error correction codes.
Schedule and Contents Information theory (1 class) Introduction to the history, aims, and current applications, etc., of information theory.
Information source coding (4 classes) Explanation is provided of various types of communication channel models, including memoryless sources and Markov information sources, followed by discussion of information source coding theorems. Hu.man and Lempel-Ziv coding and other concrete information source coding methods are described.
Channel coding theorems (2 classes) Mutual information and channel capacity are discussed, together with Shannon.s channel coding theorem.
Error detection codes and error correction codes (5 classes) Detailed explanation is made of the principles of parity check code, Hamming code, and cyclic code. Also, based on knowledge of finite fields (Galois .eld), BCH code, etc., are introduced as multiple error correction codes.
Information security (2 classes) Opportunities have increased for the electronic transmission, via networks, of important information. Explanation is provided of the coding that is essential to secure the safety of that information; special focus is given to basic items concerning public-key encryption systems, digital signatures and authentication, and other key issues.
Confirmation of extent of student learning (1 class) Confirmation is made of the extent that students have learned the contents of this course.
Evaluation Methods and Policy Based on a written examination (max. score =100), although consideration is also given to evaluations of small tests or reports (total of 1 or 2 times, max. score = 10 for each). The max. of the total score is 100.
Course Requirements Knowledge of probability (probability theory fundamentals) and algebra is desirable.
Study outside of Class (preparation and review) Students are requested to possess, and to review, their knowledge of probability (probability theory fundamentals) and algebra.
Textbooks Textbooks/References 情報理論(改訂2版), , , ISBN:9784274223259
References, etc. 代数系入門, , , ISBN:9784000298735
誤り訂正符号入門, , , ISBN:9784627817111
代数系と符号理論入門, , , ISBN:9784339024463
Related URL
PAGE TOP