トップページへ

2025 (Current Year) Faculty Courses School of Engineering Undergraduate major in Information and Communications Engineering

Communication Theory (ICT)

Academic unit or major
Undergraduate major in Information and Communications Engineering
Instructor(s)
Kazuhiko Fukawa / Wakaha Ogata
Class Format
Lecture (Face-to-face)
Media-enhanced courses
-
Day of week/Period
(Classrooms)
7-8 Mon / 7-8 Thu
Class
-
Course Code
ICT.C205
Number of credits
200
Course offered
2025
Offered quarter
2Q
Syllabus updated
Mar 19, 2025
Language
Japanese

Syllabus

Course overview and goals

This course mainly focuses on source encoding and channel coding, which are two main subjects of the information theory. The source encoding can lead to data compression, whereas the channel coding can realize reliable data transmission. First, the basis of the probability theory is reviewed, and measures of the amount of information such as the entropy and the mutual information are defined. Then, two important relations are introduced; one is the relation between the limit of the data compression and the entropy, while the other is the relation between the limit of transmission speed of reliable data transmission and the maximum value of the mutual information. Some concrete methods of the channel coding and the fundamental encryption theory are also discussed in this course.

Course description and aims

At the end of this course, students will be able to:
1) regard information and channels as abstract mathematical models,
2) explain the relation between the limit of data compression and the entropy,
3) explain the relation between the limit of transmission speed of reliable data transmission and the maximum value of the mutual information,
4) explain basic methods of the source encoding, channel coding, and encryption.

Keywords

Source encoding, channel coding, entropy, source coding theorem, channel coding theorem, encryption

Competencies

  • Specialist skills
  • Intercultural skills
  • Communication skills
  • Critical thinking skills
  • Practical and/or problem-solving skills

Class flow

Students are provided with exercise problems about items explained in each class.

Course schedule/Objectives

Course schedule Objectives
Class 1 Introduction: source encoding and channel coding Understand the course objectives.
Class 2 Representation of information and basis of the probability theory Review the basis of the probability theory.
Class 3 Entropy, mutual information, divergence Understand concepts you learn in the class.
Class 4 Model of information sources and entropy rate: stationary information source, Markov information source, entropy rate Understand concepts you learn in the class.
Class 5 Kraft's inequality, source coding theorem (converse part) Understand the converse part of the source coding theorem.
Class 6 The limit of average code length, Huffman coding Understand the limit of averate code length and Huffman coding.
Class 7 Source coding theorem (direct part) Understand the direct part of the source coding theorem.
Class 8 The midterm examination and the review of the first half Review the first half of this course.
Class 9 Model of channels Understand model of channels.
Class 10 Channel capacity Explain channel capacity.
Class 11 Channel coding theorem Understand the direct part of the channel coding theorem.
Class 12 Error correcting code: Humming code Understand error correcting code and the mechanism of Humming code
Class 13 Encryption theory: basics adn symmetric key encryption Understand the model of encryption.
Class 14 Encryption theory: public-key encryption, summarization of this course Understand the model of public-key encryption.

Study advice (preparation and review)

To enhance effective learning, students are encouraged to spend approximately 100 minutes preparing for class and another 100 minutes reviewing class content afterwards (including assignments) for each class.
They should do so by referring to textbooks and other course material.

Textbook(s)

All materials used in class can be found on Science Tokyo LMS, or provided during class.

Reference books, course materials, etc.

Tomohiko Uyematsu, An Illustrated Guide to Viewpoint of Information Theory, Ormsha, 2010 (Japanese)
Kohichi Sakaniwa, Kenta Kasai, Introduction to Communication Theory, CORONA PUBLISHING CO., LTD, 2014 (Japanese)

Evaluation methods and criteria

Student achievements are assessed based on the midterm exam (50%) and the final exam (50%).

Related courses

  • ICT.C201 : Introduction to Information and Communications Engineering
  • ICT.S206 : Signal and System Analysis
  • ICT.C209 : Algebraic Systems and Coding Theory

Prerequisites

none required