Academic year 2013-14

Image and Video Encoding Systems

Degree: Code: Type:
Bachelor's Degree in Computer Science 21485 Optional subject
Bachelor's Degree in Telematics Engineering 21765 Optional subject
Bachelor's Degree in Audiovisual Systems Engineering 21618 Compulsory subject, 3rd year

 

ECTS credits: 4 Workload: 100 hours Trimester: 2nd

 

Department: Dept. of Information and Communication Technologies
Coordinator: Nicolas Duchateau
Teaching staff:

Nicolas Duchateau

Cyriac Praveen

Language:

Nicolas Duchateau (English, [Spanish]).

Cyriac Praveen (English).

Timetable:
Building: Communication campus - Poblenou

 

Introduction

The course targets the theoretical basics, algorithms and standards for designing the compression of images and video in the field of audiovisual engineering.

 

Prerequisites

Students are recommended to have a good knowledge about the processing of images, signals and systems, mathematics, and programming.

Related (and recommended) UPF courses:

- Image processing (processament d'imatges)

- Signals and systems (senyals i sistemes)

- Data transfer and encoding (transmissió de dades i codificació)

- Video processing (processament de videos)

 

Associated competences

- Understanding of the theoretical basics of encoding and compression of images and videos.

- Knowledge about the algorithms and standards used in practice.

- Implementation of methods for real applications.

- Review of mathematical tools.

- Gaining practice in programming (efficient and clear code, documentation).

- Bibliographic search, understanding of scientific articles.

- Team work: organization, communication

 

Assessment

Evaluation: labs (50%), theory (50%), each part needs to be approved independently from the other.

There are 3 labs, evaluated successively along the trimester. Labs are done by groups of 3 students, and evaluated through deliveries (report and documented code) and an oral presentation (individual questions). In case the labs are not validated during the trimester, but the labs grade is higher or equal to 3.5/10, the student will have to do a practical individual work for the evaluation in July. This won't be possible if the labs grade is lower than 3.5/10.

Theory is evaluated in a final written exam at the end of the trimester, that can be recovered in July. In case labs are approved but the theory is not approved, the grade obtained for the labs is kept for July, but not for the next year.

Participation during the seminar sessions will also be evaluated, and could bring up to 1 extra point in the final grade.

 

Contents

Chapter 1 Introduction

1.1 Practical Needs for Image and Video Compression

1.2 Feasibility of Image and Video Compression

1.3 Visual Quality Measurement

1.4 Information Theory Results

 

Chapter 2 Quantization

2.1 Quantization and the Source Encoder

2.2 Uniform Quantization

2.3 Nonuniform Quantization

2.4 Adaptive Quantization

2.5 Pulse Code Modulation

 

Chapter 3 Differential Coding

3.1 Introduction to DPCM

3.2 Optimum Linear Prediction

3.3 Some Issues in the Implementation of DPCM

3.4 Delta Modulation

3.5 Interframe Differential Coding

3.6 Information-Preserving Differential Coding

 

Chapter 4 Transform Coding

4.1 Introduction

4.2 Linear Transforms

4.3 Transforms of Particular Interest

4.4 Bit Allocation

4.5 Some Issues

 

Chapter 5 Variable-Length Coding: Information Theory Results (II)

5.1 Some Fundamental Results

5.2 Huffman Codes

5.3 Modified Huffman Codes

5.4 Arithmetic Codes

 

Chapter 6 Run-Length and Dictionary Coding: Information Theory Results (III)

6.1 Markov Source Model

6.2 Run-Length Coding

6.3 Digital Facsimile Coding Standards

6.4 Dictionary Coding

6.5 International Standards for Lossless Still Image Compression

 

Chapter 7 Still Image Coding: Standard JPEG

7.1 Introduction

7.2 Sequential DCT-Based Encoding Algorithm

7.3 Progressive DCT-Based Encoding Algorithm

7.4 Lossless Coding Mode

7.5 Hierarchical Coding Mode

 

Chapter 8 Wavelet Transform for Image Coding: JPEG2 000

8.1 A Review of Wavelet Transform

8.2 Digital Wavelet Transform for Image Compression

8.3 Wavelet Transform for JPEG2000

 

Chapter 10 Motion Analysis and Motion Compensation

10.1 Image Sequences

10.2 Interframe Correlation

10.3 Frame Replenishment

10.4 Motion Compensated Coding

10.5 Motion Analysis

10.6 Motion Compensation for Image Sequence Process ing

 

Chapter 11 Block Matching

11.1 Nonoverlapped, Equally Spaced, Fixed Size, Small Rectangular Block Matching

11.2 Matching Criteria

11.3 Searching Procedures

11.4 Matching Accuracy

11.5 Limitations with Block Matching Techniques

11.6 New Improvements

 

Chapter 12 Pel Recursive Technique

12.1 Problem Formulation

12.2 Descent Methods

12.3 Netravali–Robbins’ Pel Recursive Algorithm

12.4 Other Pel Recursive Algorithms

12.5 Performance Comparison

 

Chapter 13 Optical Flow

13.1 Fundamentals

13.2 Gradient-Based Approach

13.3 Correlation-Based Approach

13.4 Multiple Attributes for Conservation Information

 

Chapter 14 Further Discussion and Summary on 2-D Motion Estimation

14.1 General Characterization

14.2 Different Classifications

14.3 Performance Comparison between Three Major App roaches

14.4 New Trends

 

Chapter 15 Fundamentals of Digital Video Coding

15.1 Digital Video Representation

15.2 Information Theory Results: Rate Distortion Function of Video Signal

15.3 Digital Video Formats

15.4 Current Status of Digital Video=Image Coding Standards

 

Chapter 16 Digital Video Coding Standards: MPEG-1=2 Video

16.1 Introduction

16.2 Features of MPEG-1=2 Video Coding

16.3 MPEG-2 Video Encoding

16.4 Rate Control

16.5 Optimum Mode Decision

16.6 Statistical Multiplexing Operations on Multiple Program Encoding

 

Chapter 17 Application Issues of MPEG-1=2 Video Coding

17.1 Introduction

17.2 ATSC DTV Standards

17.3 Transcoding with Bitstream Scaling

17.4 Down-Conversion Decoder

17.5 Error Concealment

 

Chapter 18 MPEG-4 Video Standard: Content-Based Video Coding

18.1 Introduction

18.2 MPEG-4 Requirements and Functionalities

18.3 Technical Description of MPEG-4 Video

18.4 MPEG-4 Visual Bitstream Syntax and Semantics

18.5 MPEG-4 Visual Profiles and Levels

18.6 MPEG-4 Video Verification Model

 

Chapter 19 ITU-T Video Coding Standards H.261 and H .263

19.1 Introduction

19.2 H.261 Video Coding Standard

19.3 H.263 Video Coding Standard

19.4 H.263 Video Coding Standard Version 2

19.5 H.263þþ Video Coding and H.26L

 

Methodology

Methodology for the theory sessions

Theory classes where the professor avoids as much as possible the use of Powerpoint-like slides.

Methodology for the seminar sessions

Exercises are resolved in small groups. Scientific articles are commented, or the works realized during the labs sessions are presented.

Methodology for the labs sessions

Implementation of algorithms for image and video compression. All the software used is open-source, and the labs have to be implemented in C++.

 

Resources

"Image and Video Compression for Multimedia Engineering: Fundamentals, Algorithms, and Standards, Second Edition". Yun Q. Shi and Huifang Sun. CRC Press; 2 edition (March 24, 2008). ISBN-10: 0849373646.