| 1. | Course Title | Information Theory | |||||||||||
| 2. | Code | 4ФЕИТ10029 | |||||||||||
| 3. | Study program | 11-IBS, 12-KIT | |||||||||||
| 4. | Organizer of the study program (unit, institute, department) | Faculty of Electrical Engineering and Information Technologies | |||||||||||
| 5. | Degree (first, second, third cycle) | Second cycle | |||||||||||
| 6. | Academic year/semester | I/1 | 7. | Number of ECTS credits | 6.00 | ||||||||
| 8. | Lecturer | Dr Venceslav Kafedziski | |||||||||||
| 9. | Course Prerequisites | ||||||||||||
| 10. | Course Goals (acquired competencies):
Upon completing the course, it is expected that the student will know the notions, concepts and techniques of information theory, to know how to apply those techniques to solve different problems of information theory, to know how to determine limits of compression and information transmission rate, to know the fundamentals of the network information theory and network coding, and to be capable of researching in the area of information theory. |
||||||||||||
| 11. | Course Syllabus:
Entropy, relative entropy, and mutual information. The asymptotic equipartition property. Entropy rate of a random process. Lossless compression. Universal source coding. Capacity of a discrete memoryless channel. Capacity of a Gaussian memoryless channel. Capacity of a vector Gaussian channel. Lossy compression. Rate distortion theory. Rate distortion of a Gaussian source. Rate distortion of a vector Gaussian source. Network information theory. Fundamental problems of network information theory and methods of their solving. Capacity of multiple access channel and capacity of broadcast channel. Network coding: fundamentals and applications in wireless communications, streaming and multimedia, content distribution networks, data storage systems. Distributed data storage. Coded computing. Quantum information theory. |
||||||||||||
| 12. | Learning methods:
Lectures, self-learning, term projects, presentations, active participation in lectures, consultations. |
||||||||||||
| 13. | Total number of course hours | 180 | |||||||||||
| 14. | Distribution of course hours | 3 + 3 | |||||||||||
| 15. | Forms of teaching | 15.1 | Lectures-theoretical teaching | 45 hours | |||||||||
| 15.2 | Exercises (laboratory, practice classes), seminars, teamwork | 45 hours | |||||||||||
| 16. | Other course activities | 16.1 | Projects, seminar papers | 30 hours | |||||||||
| 16.2 | Individual tasks | 30 hours | |||||||||||
| 16.3 | Homework and self-learning | 30 hours | |||||||||||
| 17. | Grading | ||||||||||||
| 17.1 | Exams | 0 points | |||||||||||
| 17.2 | Seminar work/project (presentation: written and oral) | 50 points | |||||||||||
| 17.3. | Activity and participation | 0 points | |||||||||||
| 17.4. | Final exam | 50 points | |||||||||||
| 18. | Grading criteria (points) | up to 50 points | 5 (five) (F) | ||||||||||
| from 51 to 60 points | 6 (six) (E) | ||||||||||||
| from 61 to 70 points | 7 (seven) (D) | ||||||||||||
| from 71 to 80 points | 8 (eight) (C) | ||||||||||||
| from 81 to 90 points | 9 (nine) (B) | ||||||||||||
| from 91 to 100 points | 10 (ten) (A) | ||||||||||||
| 19. | Conditions for acquiring teacher’s signature and for taking final exam | None | |||||||||||
| 20. | Forms of assessment |
The exam includes a written or oral final exam from the course material listed in the course content and completion and presentation of a term paper/project on a subject mutually agreed by the student and the teacher. |
|||||||||||
| 21. | Language | Macedonian and English | |||||||||||
| 22. | Method of monitoring of teaching quality | Self-evaluation | |||||||||||
| 23. | Literature | ||||||||||||
| 23.1. | Required Literature | ||||||||||||
| No. | Author | Title | Publisher | Year | |||||||||
| 1. | T. M. Cover, J. A. Thomas | Elements of Information Theory | Wiley | 2006 | |||||||||
| 23.2. | Additional Literature | ||||||||||||
| No. | Author | Title | Publisher | Year | |||||||||
| 1. | M. Medard, A. Sprintson (Editors) | Network Coding Fundamentals and Applications | Academic Press | 2012 | |||||||||
