Comparing subjective image quality measurement methods for the creation of public databases

J.A. Redi, H. Liu, H. Alers, R. Zunino, I.E.J. Heynderickx

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    29 Citations (Scopus)


    The Single Stimulus (SS) method is often chosen to collect subjective data testing no-reference objective metrics, as it is straightforward to implement and well standardized. At the same time, it exhibits some drawbacks; spread between different assessors is relatively large, and the measured ratings depend on the quality range spanned by the test samples, hence the results from different experiments cannot easily be merged . The Quality Ruler (QR) method has been proposed to overcome these inconveniences. This paper compares the performance of the SS and QR method for pictures impaired by Gaussian blur. The research goal is, on one hand, to analyze the advantages and disadvantages of both methods for quality assessment and, on the other, to make quality data of blur impaired images publicly available. The obtained results show that the confidence intervals of the QR scores are narrower than those of the SS scores. This indicates that the QR method enhances consistency across assessors. Moreover, QR scores exhibit a higher linear correlation with the distortion applied. in summary, for the purpose of building datasets of subjective quality, the QR approach seems promising from the viewpoint of both consistency and repeatability.
    Original languageEnglish
    Title of host publicationImage Quality and System Performance VII, 18-19 January 2010, San Jose
    EditorsS.P. Farnand, F. Gaykema
    Publication statusPublished - 2010
    Eventconference; Image Quality and System Performance VII -
    Duration: 1 Jan 2010 → …

    Publication series

    NameProceedings of SPIE
    ISSN (Print)0277-786X


    Conferenceconference; Image Quality and System Performance VII
    Period1/01/10 → …
    OtherImage Quality and System Performance VII


    Dive into the research topics of 'Comparing subjective image quality measurement methods for the creation of public databases'. Together they form a unique fingerprint.

    Cite this