Curricular Unit:Code:
Multimedia II831MUL2
Year:Level:Course:Credits:
3UndergraduateComputer Systems Engineering6 ects
Learning Period:Language of Instruction:Total Hours:
Spring SemesterPortuguese/English78
Learning Outcomes of the Curricular Unit:
This module aims to explore in depth the algorithms related to multimedia compression and representation, more specifically concerning non-structured media types. Therefore, it concentrates on providing the fundamentals of compression, an overview of encoding techniques used for multimedia information and an in-depth analysis of the most relevant encoding methods and standards for bitmap images, digital audio and video.
At the end of the module a student will be able to:
- Describe modes and categories of compression techniques.
- Explain and analyse entropy encoding algorithms.
- Understand psychoacoustics principles and explain the functionality of source encoding methods for audio compression.
- Understand the Rate-Distortion theory and the functionality of source encoding methods based on image transforms/wavelets for image compression.
- Identify the main components of JPEG and MPEG standards.
- Propose, project and program the studied methods and algorithms as codecs.
Syllabus:
1. Compression fundamentals
1.1 Compression modes
1.2 Classification of compression techniques. Entropy and Source encoding
1.3 Topics for evaluating a compression system
2. Lossles compression methods and standards
2.1 Notion of Entropy
2.2 Generic model for variable length and fixed compression
2.3 Shannon-Fano and Huffman methods
2.4 Arithmetic coding
2.5 Lossles compression standards: JBIG, JPEG, JPEG-LS and PNG
3. Audio compression standards
3.1 Psychoacoustics and digitization of áudio
3.2 Standards for speech compression
3.3 Standards for Hi-Fi audio compression: MPEG-Audio, Dolby AC-3
4. Image compression fundamentals
4.1 Rate-distortion theory
4.2 Scalar quantizers
4.3 Basic coding schemes for lossy compression and DCT based compression
4.4 The JPEG standard: modes and architectures
4.4.1 Color processing
4.4.2 Quantization and entropy encoding
5. Project of a multimedia codec
5.1 Planning and design
5.2 Development and programming
Demonstration of the Syllabus Coherence with the Curricular Unit's Objectives:
The syllabus covers the essential and consistent areas of knowledge required to achieve the objectives set out, as the main topics included in the program, such as: Fundamentals of compression, Lossles compression methods and standards, Audio compression standards, Image compression standards and project of a multimedia codec, cover the main aspects of study that enable students to understand the need for compression, analyse and implement image, audio and video encoding algorithms in computer programs as codecs, as well as evaluate and choose the best suited formats and standards for multimedia coding and representation.
Teaching Methodologies (Including Evaluation):
The methodology of teaching and learning is expository, interrogative and demonstrative. Drawing on problem solving and study geared to allow the interpretation of fundamental compression principles. Problems referring to audio, video and image compression are proposed, both as classroom work and individual study work.
The assessment includes:
Theoretical component:
• Two written tests evaluation (25% each, 50% of final grade)
Practical component:
• Writing a script for a scientific video/tutorial about the proposed codec (10% of final grade).
• The development of a scientific video/tutorial explaining the code for a codec (30% of final grade).
• Presentation in the classroom of the project (video and paper) (5% of final grade).
• Student performance, including attendance, resolution of proposed problems and active participation in class (5% of final grade).
Demonstration of the Coherence between the Teaching Methodologies and the Learning Outcomes:
The proposed methodologies are consistent with the objectives set for the course since they rely on the interpretation of the theory and practical application of the compression concepts studied, establishing a parallel between the theory and the practice applied to real problems of multimedia codec implementation for audio, video and images, thereby helping students develop their ability to apply such techniques in multimedia applications development in the context of Computer Systems Engineering.
Reading:
[1] Ribeiro, Nuno, Torres, José, Tecnologias de Compressão Multimédia, FCA – Editora de Informática, 2009.
[2] Sayood, K., Introduction to Data Compression, 5th Edition, Morgan Kaufman (Elsevier), 2017.
[3] McAnlis, C. & Haecky, A. Understanding Compression: Data Compression for Modern Developers, O'Reilly Media, 2016.
[4] Li, Ze-Nian, Drew, Mark S., Liu, Jiangchuan, Fundamentals of Multimedia (Texts in Computer Science), Second Edition, Springer, 2014.
[5] Salomon, D., Motta, G. Handbook of Data Compression. 5th Ed., Springer-Verlag, 2010.
[6] Ribeiro, Nuno M., Multimédia e Tecnologias Interativas, 5ª Edição Aumentada, FCA – Editora de Informática, 2012.