Multimodal Interface for Drawing Diagrams that Does not Interfere with Natural Talking and Drawing
Summary :
The aim of this research is to support real-time drawingin talking by using multimodal user interface technologies. In this situation, if talking and drawing are considered as commands by mistake during presentation, it will disturb users' natural talking and drawing. To prevent this problem, we introduce two modes of a command mode and a free mode, and explore smooth mode switching techniques that does not interfere with users' natural talking and drawing. We evaluate four techniques. Among them, a technique that specifies the command mode after actions using a pen gesture was the most effective. In this technique, users could quickly draw diagrams, and specifying mode switching didn't interfere with users' natural talk.
- Publication
- IEICE TRANSACTIONS on Electronics Vol.E102-C No.5 pp.408-415
- Publication Date
- 2019/05/01
- Publicized
- Online ISSN
- 1745-1353
- DOI
- 10.1587/transele.2018ECP5054
- Type of Manuscript
- PAPER
- Category
- Electronic Displays
Authors
Xingya XU
Gllue Software Co. Ltd.
Hirohito SHIBATA
Fuji Xerox Co. Ltd.
Keyword
Latest Issue
Copyrights notice of machine-translated contents
The copyright of the original papers published on this site belongs to IEICE. Unauthorized use of the original or translated papers is prohibited. See IEICE Provisions on Copyright for details.
Cite this
Copy
Xingya XU, Hirohito SHIBATA, "Multimodal Interface for Drawing Diagrams that Does not Interfere with Natural Talking and Drawing" in IEICE TRANSACTIONS on Electronics,
vol. E102-C, no. 5, pp. 408-415, May 2019, doi: 10.1587/transele.2018ECP5054.
Abstract: The aim of this research is to support real-time drawingin talking by using multimodal user interface technologies. In this situation, if talking and drawing are considered as commands by mistake during presentation, it will disturb users' natural talking and drawing. To prevent this problem, we introduce two modes of a command mode and a free mode, and explore smooth mode switching techniques that does not interfere with users' natural talking and drawing. We evaluate four techniques. Among them, a technique that specifies the command mode after actions using a pen gesture was the most effective. In this technique, users could quickly draw diagrams, and specifying mode switching didn't interfere with users' natural talk.
URL: https://global.ieice.org/en_transactions/electronics/10.1587/transele.2018ECP5054/_p
Copy
@ARTICLE{e102-c_5_408,
author={Xingya XU, Hirohito SHIBATA, },
journal={IEICE TRANSACTIONS on Electronics},
title={Multimodal Interface for Drawing Diagrams that Does not Interfere with Natural Talking and Drawing},
year={2019},
volume={E102-C},
number={5},
pages={408-415},
abstract={The aim of this research is to support real-time drawingin talking by using multimodal user interface technologies. In this situation, if talking and drawing are considered as commands by mistake during presentation, it will disturb users' natural talking and drawing. To prevent this problem, we introduce two modes of a command mode and a free mode, and explore smooth mode switching techniques that does not interfere with users' natural talking and drawing. We evaluate four techniques. Among them, a technique that specifies the command mode after actions using a pen gesture was the most effective. In this technique, users could quickly draw diagrams, and specifying mode switching didn't interfere with users' natural talk.},
keywords={},
doi={10.1587/transele.2018ECP5054},
ISSN={1745-1353},
month={May},}
Copy
TY - JOUR
TI - Multimodal Interface for Drawing Diagrams that Does not Interfere with Natural Talking and Drawing
T2 - IEICE TRANSACTIONS on Electronics
SP - 408
EP - 415
AU - Xingya XU
AU - Hirohito SHIBATA
PY - 2019
DO - 10.1587/transele.2018ECP5054
JO - IEICE TRANSACTIONS on Electronics
SN - 1745-1353
VL - E102-C
IS - 5
JA - IEICE TRANSACTIONS on Electronics
Y1 - May 2019
AB - The aim of this research is to support real-time drawingin talking by using multimodal user interface technologies. In this situation, if talking and drawing are considered as commands by mistake during presentation, it will disturb users' natural talking and drawing. To prevent this problem, we introduce two modes of a command mode and a free mode, and explore smooth mode switching techniques that does not interfere with users' natural talking and drawing. We evaluate four techniques. Among them, a technique that specifies the command mode after actions using a pen gesture was the most effective. In this technique, users could quickly draw diagrams, and specifying mode switching didn't interfere with users' natural talk.
ER -
English
