Delft Image Quality Lab

IQ Lab




A&A_dataset: The Aesthetics and visual Attention image dataset
EMMA: Database for emotion and mood recognition
i_QoE: A database for individual QoE analysis
Perceived Ringing
Eye-Tracking Release 1
Eye-Tracking Release 2
Video Task Effect

Perceived Ringing

The database containing subjective data of perceived ringing is publicly available to the research community. Please cite the following references if you use this database in your research.

  • H. Liu, N. Klomp and I. Heynderickx, "TUD Image Quality Database: Perceived Ringing",

  • H. Liu, N. Klomp and I. Heynderickx, "A No-Reference Metric for Perceived Ringing Artifacts in Images", IEEE Transactions on Circuits and Systems for Video Technology, vol. 20, pp 529-539, April, 2010.
    Get paper

  • H. Liu, N. Klomp and I. Heynderickx, "A Perceptually Relevant Approach to Ringing Region Detection", IEEE Transactions on Image Processing, vol. 19, pp. 1414-1426, June, 2010.
    Get paper


Database: Ringing Region Experiment
Database: Ringing Annoyance Experiment

The files are password protected. To get the password you can contact Hantao Liu (

Database Description
The subjective data on perceived ringing were collected with the aim to better understand where human beings perceive ringing artifacts in compressed images, and to develop a no-reference (NR) metric to predict perceived ringing annoyance in these compressed images. The data result from two perception experiments:

  1. the so-called ringing region experiment, and
  2. the so-called ringing annoyance experiment.

For the ringing region experiment, eight source images were JPEG compressed at two levels, yielding a database of 16 stimuli. Twelve participants were requested to mark any region in each stimulus where ringing was perceived, independent of its annoyance. The results were transformed into a subjective ringing region (SRR) map, indicating where in an image on average people see ringing.

For the ringing annoyance experiment, eleven source images were JPEG compressed at four levels, yielding a test database of 55 stimuli (including the originals). Twenty participants scored the annoyance of the ringing artifacts with a single-stimulus scoring method. A mean opinion score (MOS) was obtained for each stimulus.
More details on the experimental set-up and results can be found in the references given above.

This research group is part of the Interactive Intelligence group based in the Technical University of Delft
For questions or comments regarding this page, please contact Technical support