Seminar on Multimedia Signal Processing

Content

Visual Quality - Deep Learning - Just noticeable differences - Data Analysis

In this seminar we cover topics relevant to the current Bachelor, Master, and PhD projects in the Multimedia Signal Processing Group.

  • Image and video quality assessment (IQA/VQA): Nowadays, multimedia data are ubiquitous. You take pictures and videos with your camera and camcorders everyday. Have you thought about how you can judge the perceptual quality of the pictures and videos you made and how good your camera/camcorder is? In this seminar, we will discuss algorithms for image and video quality assessment. Topics will be related to our ongoing VQA Project in the SFB TRR 161. 
  • Recently deep learning has been applied to the problem of IQA/VQA and we will cover several approaches in the seminar.
  • We will read and discuss papers about "Justnoticeable differences" when comparing an original image/video with a version that has been slightly distorted or enhanced.
  • The seminar is a good preparation for a student project in multimedia signal processing that can one or more of the following: quality assessment algorithms, crowdsourcing perceptual quality, eye tracking, data analysis.

Requirements

Requirements for obtaining ECTS credits for this seminar are:

  • regular attendance at the weekly seminar
  • self-study of one or more scientific papers on selected topics
  • oral presentation of 45 minutes including discussion
  • written essay on the subject of the presentation (about 10-20 pages, typeset, electronic submission as one pdf)

Prerequisites

Students with a keen interest in multimedia signal processing are welcome to participate in the seminar. Especially those that have previously taken relevant courses like, e.g., Digital Signal Processing, Eye Tracking Theory and Practice, Machine Learning Using MATLAB, Deep Learning Programming, Image Processing.

Topics and Literature

 Topic: Learning from rankings

Topic: Image augmentations for database enhancement

  • Zhu, Y., Zhai, G., Zhu, W. and Zhou, J., 2018, May. An Image Augmentation Method for Quality Assessment Database. In 2018 IEEE International Symposium on Circuits and Systems (ISCAS). Abstract available online at IEEE. Will get the paper asap

Topic: Artifact detection in video

  • Goodall, T.R., Bovik, A., Detecting and Mapping Video Impairments, IEEE Transactions on Image Processing 28(6), June 2019. Thesis available online: Goodall, T.R., 2018. Inspection and evaluation of artifacts in digital video sources (Doctoral dissertation). Also the software is available online and should be tried out for the seminar. Thesis: https://repositories.lib.utexas.edu/handle/2152/68147

Topic: Just noticeable differences I

  • Katsigiannis, S., Scovell, J., Ramzan, N., Janowski, L., Corriveau, P., Saad, M.A. and Van Wallendael, G., 2018. Interpreting MOS scores, when can users see a difference? Understanding user experience differences for photo quality. Quality and User Experience, 3(1), p.6. Paper: https://link.springer.com/article/10.1007/s41233-018-0019-8

Topic: Just noticeable differences II

Topic: Weighted mean square errors

  • Hu, S., Jin, L., Wang, H., Zhang, Y., Kwong, S. and Kuo, C.C.J., 2017. Objective video quality assessment based on perceptually weighted mean squared error. IEEE Transactions on Circuits and Systems for Video Technology, 27(9), pp.1844-1855. Paper: http://codec.siat.ac.cn/downloads/publications/47.pdf