2024 Faculty Courses School of Engineering Undergraduate major in Electrical and Electronic Engineering
Communication Theory (Electrical and Electronic Engineering)
- Academic unit or major
- Undergraduate major in Electrical and Electronic Engineering
- Instructor(s)
- Hiroo Suzuki / Takashi Tomura / Gia Khanh Tran
- Class Format
- Lecture (Face-to-face)
- Media-enhanced courses
- -
- Day of week/Period
(Classrooms) - 1-2 Tue / 1-2 Fri
- Class
- -
- Course Code
- EEE.S341
- Number of credits
- 200
- Course offered
- 2024
- Offered quarter
- 4Q
- Syllabus updated
- Mar 14, 2025
- Language
- Japanese
Syllabus
Course overview and goals
Students learn fundamental knowledge from information theory.
They can assume the basic models of information, and learn several theories such as various codings (Prefix coding, Huffman coding, Elias coding, Ziv-Lempel coding), the fundamental theorem of channel capacity, forward error correction (Linear Block code, cyclic code, convolutional code, LDPC code), and basic encryption (Public key).
Course description and aims
Students can gain an understanding of and acquire knowledge of fundamental theories of information coding, compression, channel capacity, various forward error corrections, and encryption.
Corresponding educational goals are:
(1) Specialist skills Fundamental specialist skills
(4) Applied skills (inquisitive thinking and/or problem-finding skills) Organization and analysis
(7) Skills acquiring a wide range of expertise, and expanding it into more advanced and other specialized areas
Keywords
information code, information compression, channel capacity, forward error correction, encryption
Competencies
- Specialist skills
- Intercultural skills
- Communication skills
- Critical thinking skills
- Practical and/or problem-solving skills
- ・Applied specialist skills on EEE
Class flow
At the beginning of each class, answers to the exercises from the last class are explained. Next, the instructor lectures on the material for that class. Towards the end of the class, students are given time for exercise problems.
Before class, the texts are uploaded to the OCW-i web site. Students should download them, and briefly read them. After class, they are requested to read the texts for understanding the class material.
Course schedule/Objectives
| Course schedule | Objectives | |
|---|---|---|
| Class 1 | Introduction to Information Theory: Model, Amount of Information, Entropy | Read Chapter 1-2 of the textbook. Read through Text (Class 1) on T2Schola before lecture, and review after it. |
| Class 2 | Information code (Information coding, Prefix coding, Source coding theorem) | Read Chapter 3 of the textbook. Read through Text (Class 2) on T2Schola before lecture, and review after it. |
| Class 3 | Data compression (1st half) | Read 1st half of Chapter 4 of the textbook. Read through Text (Class 3) on T2Schola before lecture, and review after it. |
| Class 4 | Data compression (2nd half) | Read 2nd half of Chapter 4 of the textbook. Read through Text (Class 4) on T2Schola before lecture, and review after it. |
| Class 5 | Channel Capacity (Probability Model, Amount of Mutual Information, Channel Capacity) | Read Chapter 5 of the textbook. Read through Text (Class 5) on T2Schola before lecture, and review after it. |
| Class 6 | Channel coding (Channel coding Theorem, Repetition Code) | Read Chapter 5 of the textbook. Read Section 6.1-6.2 of the textbook. Read through Text (Class 6) on T2Schola before lecture, and review after it. |
| Class 7 | Summary of the First Half of the Course and Comprehensive Exercise 1 | Contents from 1st to 6th lectures. |
| Class 8 | Forward Error Correction (Linear Block Code) | Read Section 6.3-6.4 of the textbook. Read through Text (Class 8) on T2Schola before lecture, and review after it. |
| Class 9 | Forward Error Correction (Cyclic code, Convolutional Code) | Read Section 6.5 of the textbook. Read through Text (Class 9) on T2Schola before lecture, and review after it. |
| Class 10 | Forward Error Correction (LDPC Code) | Read Section 6.6 of the textbook. Read through Text (Class 10) on T2Schola before lecture, and review after it. |
| Class 11 | Continuous Channel | Read Chapter 7 of the textbook. Read through Text (Class 11) on T2Schola before lecture, and review after it. |
| Class 12 | Fundamental Theory of Encryption | Read Section 8.1-8.2 of the textbook. Read through Text (Class 12) on T2Schola before lecture, and review after it. |
| Class 13 | Examples of Encryption (Symmetric Encryption, Hash Function. Public Key Encryption) | Read Section 8.3-8.7 of the textbook. Read through Text (Class 13) on T2Schola before lecture, and review after it. |
| Class 14 | Summary of the Second Half of the Course and Comprehensive Exercise 2 | Contents from 8th to 13th lectures. |
Study advice (preparation and review)
To enhance effective learning, students are encouraged to spend approximately 100 minutes preparing for class and another 100 minutes reviewing class content afterward (including assignments) for each class.
They should do so by referring to textbooks and other course material.
Textbook(s)
Kohichi Sakaniwa, Kenta Kasai, "Introduction to Communication Theory" (in Japanese), Corona Publishing Co., Ltd.
Reference books, course materials, etc.
Tomohiko Uematsu, "イラストで学ぶ情報理論の考え方"(in Japanese), Kodansha
Evaluation methods and criteria
Evaluate the level to which students understand the fundamentals of optical communication systems and component technologies.
40% for general exercise 1, 40% for general exercise, and 20% for exercises.
Related courses
- Signal System
- Optoelectronics
Prerequisites
Students should have the fundamental knowledge of Mathematics for 1st and 2nd Grade of undergraduate school.