Pronunciation is a fundamental factor in speaking and listening. However, instructions for important articulation have not been sufficiently provided in conventional computer-assisted language learning (CALL) systems. One typical case is the articulation of rounded vowels. Although lip protrusion is essential for their correct pronunciation, the perception of lip protrusion is often difficult for beginners. To tackle this issue, we propose an innovative method that will provide a comprehensive visual explanation for articulation. Lip movements are three-dimensionally measured, and face images or videos are pseudocoloured on the basis of the movements. The coloured regions represent the lip protrusion of rounded vowels. To verify the learning effect of the proposed method, we conducted experiments with Japanese undergraduates in Chinese classes. The results showed that our method has advantages over conventional video materials.
Siyang YU
Kyoto University
Kazuaki KONDO
Kyoto University
Yuichi NAKAMURA
Kyoto University
Takayuki NAKAJIMA
Kyoto University
Hiroaki NANJO
Kyoto University
Masatake DANTSUJI
Kyoto University
The copyright of the original papers published on this site belongs to IEICE. Unauthorized use of the original or translated papers is prohibited. See IEICE Provisions on Copyright for details.
Copy
Siyang YU, Kazuaki KONDO, Yuichi NAKAMURA, Takayuki NAKAJIMA, Hiroaki NANJO, Masatake DANTSUJI, "Visual Emphasis of Lip Protrusion for Pronunciation Learning" in IEICE TRANSACTIONS on Information,
vol. E102-D, no. 1, pp. 156-164, January 2019, doi: 10.1587/transinf.2017EDP7411.
Abstract: Pronunciation is a fundamental factor in speaking and listening. However, instructions for important articulation have not been sufficiently provided in conventional computer-assisted language learning (CALL) systems. One typical case is the articulation of rounded vowels. Although lip protrusion is essential for their correct pronunciation, the perception of lip protrusion is often difficult for beginners. To tackle this issue, we propose an innovative method that will provide a comprehensive visual explanation for articulation. Lip movements are three-dimensionally measured, and face images or videos are pseudocoloured on the basis of the movements. The coloured regions represent the lip protrusion of rounded vowels. To verify the learning effect of the proposed method, we conducted experiments with Japanese undergraduates in Chinese classes. The results showed that our method has advantages over conventional video materials.
URL: https://global.ieice.org/en_transactions/information/10.1587/transinf.2017EDP7411/_p
Copy
@ARTICLE{e102-d_1_156,
author={Siyang YU, Kazuaki KONDO, Yuichi NAKAMURA, Takayuki NAKAJIMA, Hiroaki NANJO, Masatake DANTSUJI, },
journal={IEICE TRANSACTIONS on Information},
title={Visual Emphasis of Lip Protrusion for Pronunciation Learning},
year={2019},
volume={E102-D},
number={1},
pages={156-164},
abstract={Pronunciation is a fundamental factor in speaking and listening. However, instructions for important articulation have not been sufficiently provided in conventional computer-assisted language learning (CALL) systems. One typical case is the articulation of rounded vowels. Although lip protrusion is essential for their correct pronunciation, the perception of lip protrusion is often difficult for beginners. To tackle this issue, we propose an innovative method that will provide a comprehensive visual explanation for articulation. Lip movements are three-dimensionally measured, and face images or videos are pseudocoloured on the basis of the movements. The coloured regions represent the lip protrusion of rounded vowels. To verify the learning effect of the proposed method, we conducted experiments with Japanese undergraduates in Chinese classes. The results showed that our method has advantages over conventional video materials.},
keywords={},
doi={10.1587/transinf.2017EDP7411},
ISSN={1745-1361},
month={January},}
Copy
TY - JOUR
TI - Visual Emphasis of Lip Protrusion for Pronunciation Learning
T2 - IEICE TRANSACTIONS on Information
SP - 156
EP - 164
AU - Siyang YU
AU - Kazuaki KONDO
AU - Yuichi NAKAMURA
AU - Takayuki NAKAJIMA
AU - Hiroaki NANJO
AU - Masatake DANTSUJI
PY - 2019
DO - 10.1587/transinf.2017EDP7411
JO - IEICE TRANSACTIONS on Information
SN - 1745-1361
VL - E102-D
IS - 1
JA - IEICE TRANSACTIONS on Information
Y1 - January 2019
AB - Pronunciation is a fundamental factor in speaking and listening. However, instructions for important articulation have not been sufficiently provided in conventional computer-assisted language learning (CALL) systems. One typical case is the articulation of rounded vowels. Although lip protrusion is essential for their correct pronunciation, the perception of lip protrusion is often difficult for beginners. To tackle this issue, we propose an innovative method that will provide a comprehensive visual explanation for articulation. Lip movements are three-dimensionally measured, and face images or videos are pseudocoloured on the basis of the movements. The coloured regions represent the lip protrusion of rounded vowels. To verify the learning effect of the proposed method, we conducted experiments with Japanese undergraduates in Chinese classes. The results showed that our method has advantages over conventional video materials.
ER -