Subjective Multimedia Quality Assessment

Matthew D. BROTHERTON; Quan HUYNH-THU; David S. HANDS; Kjell BRUNNSTROM

doi:10.1093/ietfec/e89-a.11.2920

Subjective Multimedia Quality Assessment

Matthew D. BROTHERTON, Quan HUYNH-THU, David S. HANDS, Kjell BRUNNSTROM

Full Text Views

0

Cite this

Summary :

The Video Quality Experts Group (VQEG) is preparing a programme of subjective multimedia quality tests. The results from these tests will be used to evaluate the performance of competing objective multimedia quality metrics. The reliability of the subjective test data is of great importance for VQEG's task. This paper provides an overview of VQEG's multimedia ad-hoc group. The work of this group will require subjective tests to be performed by laboratories located in Europe, Asia and North America. For VQEG's multimedia work to be successful, the subjective assessment methodology must be precisely defined and produce reliable and repeatable subjective quality data. Although international standards covering multimedia quality assessment methods are in force, there remains some uncertainty regarding the most effective approach to assessing the subjective quality of multimedia. A review of existing methods is provided. Two experiments are presented investigating the suitability of alternative subjective assessment methods (single-stimulus ACR and SAMVIQ). The results of these experiments are discussed within the context of the VQEG multimedia testing programme.

Publication: IEICE TRANSACTIONS on Fundamentals Vol.E89-A No.11 pp.2920-2932

Publication Date: 2006/11/01

Publicized

Online ISSN: 1745-1337

DOI: 10.1093/ietfec/e89-a.11.2920

Type of Manuscript: Special Section INVITED PAPER (Special Section on Image Media Quality)

Category

Cite this

Copy

Matthew D. BROTHERTON, Quan HUYNH-THU, David S. HANDS, Kjell BRUNNSTROM, "Subjective Multimedia Quality Assessment" in IEICE TRANSACTIONS on Fundamentals, vol. E89-A, no. 11, pp. 2920-2932, November 2006, doi: 10.1093/ietfec/e89-a.11.2920.
Abstract: The Video Quality Experts Group (VQEG) is preparing a programme of subjective multimedia quality tests. The results from these tests will be used to evaluate the performance of competing objective multimedia quality metrics. The reliability of the subjective test data is of great importance for VQEG's task. This paper provides an overview of VQEG's multimedia ad-hoc group. The work of this group will require subjective tests to be performed by laboratories located in Europe, Asia and North America. For VQEG's multimedia work to be successful, the subjective assessment methodology must be precisely defined and produce reliable and repeatable subjective quality data. Although international standards covering multimedia quality assessment methods are in force, there remains some uncertainty regarding the most effective approach to assessing the subjective quality of multimedia. A review of existing methods is provided. Two experiments are presented investigating the suitability of alternative subjective assessment methods (single-stimulus ACR and SAMVIQ). The results of these experiments are discussed within the context of the VQEG multimedia testing programme.
URL: https://global.ieice.org/en_transactions/fundamentals/10.1093/ietfec/e89-a.11.2920/_p

Copy

@ARTICLE{e89-a_11_2920,
author={Matthew D. BROTHERTON, Quan HUYNH-THU, David S. HANDS, Kjell BRUNNSTROM, },
journal={IEICE TRANSACTIONS on Fundamentals},
title={Subjective Multimedia Quality Assessment},
year={2006},
volume={E89-A},
number={11},
pages={2920-2932},
abstract={The Video Quality Experts Group (VQEG) is preparing a programme of subjective multimedia quality tests. The results from these tests will be used to evaluate the performance of competing objective multimedia quality metrics. The reliability of the subjective test data is of great importance for VQEG's task. This paper provides an overview of VQEG's multimedia ad-hoc group. The work of this group will require subjective tests to be performed by laboratories located in Europe, Asia and North America. For VQEG's multimedia work to be successful, the subjective assessment methodology must be precisely defined and produce reliable and repeatable subjective quality data. Although international standards covering multimedia quality assessment methods are in force, there remains some uncertainty regarding the most effective approach to assessing the subjective quality of multimedia. A review of existing methods is provided. Two experiments are presented investigating the suitability of alternative subjective assessment methods (single-stimulus ACR and SAMVIQ). The results of these experiments are discussed within the context of the VQEG multimedia testing programme.},
keywords={},
doi={10.1093/ietfec/e89-a.11.2920},
ISSN={1745-1337},
month={November},}

Copy

TY - JOUR
TI - Subjective Multimedia Quality Assessment
T2 - IEICE TRANSACTIONS on Fundamentals
SP - 2920
EP - 2932
AU - Matthew D. BROTHERTON
AU - Quan HUYNH-THU
AU - David S. HANDS
AU - Kjell BRUNNSTROM
PY - 2006
DO - 10.1093/ietfec/e89-a.11.2920
JO - IEICE TRANSACTIONS on Fundamentals
SN - 1745-1337
VL - E89-A
IS - 11
JA - IEICE TRANSACTIONS on Fundamentals
Y1 - November 2006
AB - The Video Quality Experts Group (VQEG) is preparing a programme of subjective multimedia quality tests. The results from these tests will be used to evaluate the performance of competing objective multimedia quality metrics. The reliability of the subjective test data is of great importance for VQEG's task. This paper provides an overview of VQEG's multimedia ad-hoc group. The work of this group will require subjective tests to be performed by laboratories located in Europe, Asia and North America. For VQEG's multimedia work to be successful, the subjective assessment methodology must be precisely defined and produce reliable and repeatable subjective quality data. Although international standards covering multimedia quality assessment methods are in force, there remains some uncertainty regarding the most effective approach to assessing the subjective quality of multimedia. A review of existing methods is provided. Two experiments are presented investigating the suitability of alternative subjective assessment methods (single-stimulus ACR and SAMVIQ). The results of these experiments are discussed within the context of the VQEG multimedia testing programme.
ER -