Methods of Improving the Accuracy and Reproducibility of Objective Quality Assessment of VoIP Speech

Akira TAKAHASHI; Masataka MASUDA; Atsuko KURASHIMA

Methods of Improving the Accuracy and Reproducibility of Objective Quality Assessment of VoIP Speech

Akira TAKAHASHI, Masataka MASUDA, Atsuko KURASHIMA

Full Text Views

0

Cite this

Summary :

VoIP is one of the key technologies for recent telecommunication services. The quality of its services should be discussed in subjective terms. Since subjective quality assessment is time-consuming and expensive, however, objective quality assessment which estimates subjective quality without carrying out subjective quality experiments is desirable. This paper discusses the performance of the objective quality measure that was standardized as ITU-T Recommendation P.862 and clarifies the quality factors that can be evaluated with satisfactory accuracy based on it. We found that P.862 can be applied to the evaluation of coding distortion, tandeming of codecs, transmission bit-errors, packet loss, and silence compression in a codec, at least for clean Japanese speech. In addition, we propose a method of estimating the subjective quality evaluation value from objective measurement results and show the validity of this method. We also evaluate the uniqueness of objective quality assessment based on P.862 from the viewpoints of the effect of measurement noise and the variation of test speech samples, and propose how to improve the reproducibility of objective quality assessment.

Publication: IEICE TRANSACTIONS on Communications Vol.E87-B No.6 pp.1660-1669

Publication Date: 2004/06/01

Publicized

Online ISSN

DOI

Type of Manuscript: PAPER

Category: Multimedia Systems

Cite this

Copy

Akira TAKAHASHI, Masataka MASUDA, Atsuko KURASHIMA, "Methods of Improving the Accuracy and Reproducibility of Objective Quality Assessment of VoIP Speech" in IEICE TRANSACTIONS on Communications, vol. E87-B, no. 6, pp. 1660-1669, June 2004, doi: .
Abstract: VoIP is one of the key technologies for recent telecommunication services. The quality of its services should be discussed in subjective terms. Since subjective quality assessment is time-consuming and expensive, however, objective quality assessment which estimates subjective quality without carrying out subjective quality experiments is desirable. This paper discusses the performance of the objective quality measure that was standardized as ITU-T Recommendation P.862 and clarifies the quality factors that can be evaluated with satisfactory accuracy based on it. We found that P.862 can be applied to the evaluation of coding distortion, tandeming of codecs, transmission bit-errors, packet loss, and silence compression in a codec, at least for clean Japanese speech. In addition, we propose a method of estimating the subjective quality evaluation value from objective measurement results and show the validity of this method. We also evaluate the uniqueness of objective quality assessment based on P.862 from the viewpoints of the effect of measurement noise and the variation of test speech samples, and propose how to improve the reproducibility of objective quality assessment.
URL: https://global.ieice.org/en_transactions/communications/10.1587/e87-b_6_1660/_p

Copy

@ARTICLE{e87-b_6_1660,
author={Akira TAKAHASHI, Masataka MASUDA, Atsuko KURASHIMA, },
journal={IEICE TRANSACTIONS on Communications},
title={Methods of Improving the Accuracy and Reproducibility of Objective Quality Assessment of VoIP Speech},
year={2004},
volume={E87-B},
number={6},
pages={1660-1669},
abstract={VoIP is one of the key technologies for recent telecommunication services. The quality of its services should be discussed in subjective terms. Since subjective quality assessment is time-consuming and expensive, however, objective quality assessment which estimates subjective quality without carrying out subjective quality experiments is desirable. This paper discusses the performance of the objective quality measure that was standardized as ITU-T Recommendation P.862 and clarifies the quality factors that can be evaluated with satisfactory accuracy based on it. We found that P.862 can be applied to the evaluation of coding distortion, tandeming of codecs, transmission bit-errors, packet loss, and silence compression in a codec, at least for clean Japanese speech. In addition, we propose a method of estimating the subjective quality evaluation value from objective measurement results and show the validity of this method. We also evaluate the uniqueness of objective quality assessment based on P.862 from the viewpoints of the effect of measurement noise and the variation of test speech samples, and propose how to improve the reproducibility of objective quality assessment.},
keywords={},
doi={},
ISSN={},
month={June},}

Copy

TY - JOUR
TI - Methods of Improving the Accuracy and Reproducibility of Objective Quality Assessment of VoIP Speech
T2 - IEICE TRANSACTIONS on Communications
SP - 1660
EP - 1669
AU - Akira TAKAHASHI
AU - Masataka MASUDA
AU - Atsuko KURASHIMA
PY - 2004
DO -
JO - IEICE TRANSACTIONS on Communications
SN -
VL - E87-B
IS - 6
JA - IEICE TRANSACTIONS on Communications
Y1 - June 2004
AB - VoIP is one of the key technologies for recent telecommunication services. The quality of its services should be discussed in subjective terms. Since subjective quality assessment is time-consuming and expensive, however, objective quality assessment which estimates subjective quality without carrying out subjective quality experiments is desirable. This paper discusses the performance of the objective quality measure that was standardized as ITU-T Recommendation P.862 and clarifies the quality factors that can be evaluated with satisfactory accuracy based on it. We found that P.862 can be applied to the evaluation of coding distortion, tandeming of codecs, transmission bit-errors, packet loss, and silence compression in a codec, at least for clean Japanese speech. In addition, we propose a method of estimating the subjective quality evaluation value from objective measurement results and show the validity of this method. We also evaluate the uniqueness of objective quality assessment based on P.862 from the viewpoints of the effect of measurement noise and the variation of test speech samples, and propose how to improve the reproducibility of objective quality assessment.
ER -