IEICE TRANSACTIONS on Information
NOCOA+: Multimodal Computer-Based Training for Social and Communication Skills
Summary :
Non-verbal communication incorporating visual, audio, and contextual information is important to make sense of and navigate the social world. Individuals who have trouble with social situations often have difficulty recognizing these sorts of non-verbal social signals. In this article, we propose a training tool NOCOA+ (Non-verbal COmmuniation for Autism plus) that uses utterances in visual and audio modalities in non-verbal communication training. We describe the design of NOCOA+, and further perform an experimental evaluation in which we examine its potential as a tool for computer-based training of non-verbal communication skills for people with social and communication difficulties. In a series of four experiments, we investigated 1) the effect of temporal context on the ability to recognize social signals in testing context, 2) the effect of modality of presentation of social stimulus on ability to recognize non-verbal information, 3) the correlation between autistic traits as measured by the autism spectrum quotient (AQ) and non-verbal behavior recognition skills measured by NOCOA+, 4) the effectiveness of computer-based training in improving social skills. We found that context information was helpful for recognizing non-verbal behaviors, and the effect of modality was different. The results also showed a significant relationship between the AQ communication and socialization scores and non-verbal communication skills, and that social skills were significantly improved through computer-based training.
- Publication
- IEICE TRANSACTIONS on Information Vol.E98-D No.8 pp.1536-1544
- Publication Date
- 2015/08/01
- Publicized
- 2015/04/28
- Online ISSN
- 1745-1361
- DOI
- 10.1587/transinf.2014EDP7400
- Type of Manuscript
- PAPER
- Category
- Educational Technology
Authors
Hiroki TANAKA
Nara Institute of Science and Technology
Sakriani SAKTI
Nara Institute of Science and Technology
Graham NEUBIG
Nara Institute of Science and Technology
Tomoki TODA
Nara Institute of Science and Technology
Satoshi NAKAMURA
Nara Institute of Science and Technology
Keyword
Latest Issue
Copyrights notice of machine-translated contents
The copyright of the original papers published on this site belongs to IEICE. Unauthorized use of the original or translated papers is prohibited. See IEICE Provisions on Copyright for details.
Cite this
Copy
Hiroki TANAKA, Sakriani SAKTI, Graham NEUBIG, Tomoki TODA, Satoshi NAKAMURA, "NOCOA+: Multimodal Computer-Based Training for Social and Communication Skills" in IEICE TRANSACTIONS on Information,
vol. E98-D, no. 8, pp. 1536-1544, August 2015, doi: 10.1587/transinf.2014EDP7400.
Abstract: Non-verbal communication incorporating visual, audio, and contextual information is important to make sense of and navigate the social world. Individuals who have trouble with social situations often have difficulty recognizing these sorts of non-verbal social signals. In this article, we propose a training tool NOCOA+ (Non-verbal COmmuniation for Autism plus) that uses utterances in visual and audio modalities in non-verbal communication training. We describe the design of NOCOA+, and further perform an experimental evaluation in which we examine its potential as a tool for computer-based training of non-verbal communication skills for people with social and communication difficulties. In a series of four experiments, we investigated 1) the effect of temporal context on the ability to recognize social signals in testing context, 2) the effect of modality of presentation of social stimulus on ability to recognize non-verbal information, 3) the correlation between autistic traits as measured by the autism spectrum quotient (AQ) and non-verbal behavior recognition skills measured by NOCOA+, 4) the effectiveness of computer-based training in improving social skills. We found that context information was helpful for recognizing non-verbal behaviors, and the effect of modality was different. The results also showed a significant relationship between the AQ communication and socialization scores and non-verbal communication skills, and that social skills were significantly improved through computer-based training.
URL: https://global.ieice.org/en_transactions/information/10.1587/transinf.2014EDP7400/_p
Copy
@ARTICLE{e98-d_8_1536,
author={Hiroki TANAKA, Sakriani SAKTI, Graham NEUBIG, Tomoki TODA, Satoshi NAKAMURA, },
journal={IEICE TRANSACTIONS on Information},
title={NOCOA+: Multimodal Computer-Based Training for Social and Communication Skills},
year={2015},
volume={E98-D},
number={8},
pages={1536-1544},
abstract={Non-verbal communication incorporating visual, audio, and contextual information is important to make sense of and navigate the social world. Individuals who have trouble with social situations often have difficulty recognizing these sorts of non-verbal social signals. In this article, we propose a training tool NOCOA+ (Non-verbal COmmuniation for Autism plus) that uses utterances in visual and audio modalities in non-verbal communication training. We describe the design of NOCOA+, and further perform an experimental evaluation in which we examine its potential as a tool for computer-based training of non-verbal communication skills for people with social and communication difficulties. In a series of four experiments, we investigated 1) the effect of temporal context on the ability to recognize social signals in testing context, 2) the effect of modality of presentation of social stimulus on ability to recognize non-verbal information, 3) the correlation between autistic traits as measured by the autism spectrum quotient (AQ) and non-verbal behavior recognition skills measured by NOCOA+, 4) the effectiveness of computer-based training in improving social skills. We found that context information was helpful for recognizing non-verbal behaviors, and the effect of modality was different. The results also showed a significant relationship between the AQ communication and socialization scores and non-verbal communication skills, and that social skills were significantly improved through computer-based training.},
keywords={},
doi={10.1587/transinf.2014EDP7400},
ISSN={1745-1361},
month={August},}
Copy
TY - JOUR
TI - NOCOA+: Multimodal Computer-Based Training for Social and Communication Skills
T2 - IEICE TRANSACTIONS on Information
SP - 1536
EP - 1544
AU - Hiroki TANAKA
AU - Sakriani SAKTI
AU - Graham NEUBIG
AU - Tomoki TODA
AU - Satoshi NAKAMURA
PY - 2015
DO - 10.1587/transinf.2014EDP7400
JO - IEICE TRANSACTIONS on Information
SN - 1745-1361
VL - E98-D
IS - 8
JA - IEICE TRANSACTIONS on Information
Y1 - August 2015
AB - Non-verbal communication incorporating visual, audio, and contextual information is important to make sense of and navigate the social world. Individuals who have trouble with social situations often have difficulty recognizing these sorts of non-verbal social signals. In this article, we propose a training tool NOCOA+ (Non-verbal COmmuniation for Autism plus) that uses utterances in visual and audio modalities in non-verbal communication training. We describe the design of NOCOA+, and further perform an experimental evaluation in which we examine its potential as a tool for computer-based training of non-verbal communication skills for people with social and communication difficulties. In a series of four experiments, we investigated 1) the effect of temporal context on the ability to recognize social signals in testing context, 2) the effect of modality of presentation of social stimulus on ability to recognize non-verbal information, 3) the correlation between autistic traits as measured by the autism spectrum quotient (AQ) and non-verbal behavior recognition skills measured by NOCOA+, 4) the effectiveness of computer-based training in improving social skills. We found that context information was helpful for recognizing non-verbal behaviors, and the effect of modality was different. The results also showed a significant relationship between the AQ communication and socialization scores and non-verbal communication skills, and that social skills were significantly improved through computer-based training.
ER -
English
