A Comparison Study on Camera-Based Pointing Techniques for Handheld Displays

Liang CHEN; Dongyi CHEN

doi:10.1587/transele.2020DIP0003

IEICE TRANSACTIONS on Electronics

Open Access
A Comparison Study on Camera-Based Pointing Techniques for Handheld Displays

Liang CHEN, Dongyi CHEN

Full Text Views

55

Cite this

Free PDF (900.7KB)

Summary :

Input devices based on direct touch have replaced traditional ones and become the mainstream interactive technology for handheld devices. Although direct touch interaction proves to be easy to use, its problems, e.g. the occlusion problem and the fat finger problem, lower user experience. Camera-based mobile interaction is one of the solutions to overcome the problems. There are two typical interaction styles to generate camera-based pointing interaction for handheld devices: move the device or move an object before the camera. In the first interaction style, there are two approaches to move a cursor's position across the handheld display: move it towards the same direction or the opposite direction which the device moves to. In this paper, the results of a comparison research, which compared the pointing performances of three camera-based pointing techniques, are presented. All pointing techniques utilized input from the rear-facing camera. The results indicate that the interaction style of moving a finger before the camera outperforms the other one in efficiency, accuracy, and throughput. The results also indicate that within the interaction style of moving the device, the cursor positioning style of moving the cursor to the opposite direction is slightly better than the other one in efficiency and throughput. Based on the findings, we suggest giving priority to the interaction style of moving a finger when deploying camera-based pointing techniques on handheld devices. Given that the interaction style of moving the device supports one-handed manipulation, it also worth deploying when one-handed interaction is needed. According to the results, the cursor positioning style of moving the cursor towards the opposite direction which the device moves to may be a better choice.

Publication: IEICE TRANSACTIONS on Electronics Vol.E104-C No.2 pp.73-80

Publication Date: 2021/02/01

Publicized: 2020/08/04

Online ISSN: 1745-1353

DOI: 10.1587/transele.2020DIP0003

Type of Manuscript: Special Section PAPER (Special Section on Electronic Displays)

Category: Electromechanical Devices and Components

Authors

Liang CHEN
University of Electronic Science and Technology of China
Dongyi CHEN
University of Electronic Science and Technology of China

Keyword

handheld devices, handheld displays, camera-based interaction, Fitts' law, pointing techniques

Cite this

Copy

Liang CHEN, Dongyi CHEN, "A Comparison Study on Camera-Based Pointing Techniques for Handheld Displays" in IEICE TRANSACTIONS on Electronics, vol. E104-C, no. 2, pp. 73-80, February 2021, doi: 10.1587/transele.2020DIP0003.
Abstract: Input devices based on direct touch have replaced traditional ones and become the mainstream interactive technology for handheld devices. Although direct touch interaction proves to be easy to use, its problems, e.g. the occlusion problem and the fat finger problem, lower user experience. Camera-based mobile interaction is one of the solutions to overcome the problems. There are two typical interaction styles to generate camera-based pointing interaction for handheld devices: move the device or move an object before the camera. In the first interaction style, there are two approaches to move a cursor's position across the handheld display: move it towards the same direction or the opposite direction which the device moves to. In this paper, the results of a comparison research, which compared the pointing performances of three camera-based pointing techniques, are presented. All pointing techniques utilized input from the rear-facing camera. The results indicate that the interaction style of moving a finger before the camera outperforms the other one in efficiency, accuracy, and throughput. The results also indicate that within the interaction style of moving the device, the cursor positioning style of moving the cursor to the opposite direction is slightly better than the other one in efficiency and throughput. Based on the findings, we suggest giving priority to the interaction style of moving a finger when deploying camera-based pointing techniques on handheld devices. Given that the interaction style of moving the device supports one-handed manipulation, it also worth deploying when one-handed interaction is needed. According to the results, the cursor positioning style of moving the cursor towards the opposite direction which the device moves to may be a better choice.
URL: https://global.ieice.org/en_transactions/electronics/10.1587/transele.2020DIP0003/_p

Copy

@ARTICLE{e104-c_2_73,
author={Liang CHEN, Dongyi CHEN, },
journal={IEICE TRANSACTIONS on Electronics},
title={A Comparison Study on Camera-Based Pointing Techniques for Handheld Displays},
year={2021},
volume={E104-C},
number={2},
pages={73-80},
abstract={Input devices based on direct touch have replaced traditional ones and become the mainstream interactive technology for handheld devices. Although direct touch interaction proves to be easy to use, its problems, e.g. the occlusion problem and the fat finger problem, lower user experience. Camera-based mobile interaction is one of the solutions to overcome the problems. There are two typical interaction styles to generate camera-based pointing interaction for handheld devices: move the device or move an object before the camera. In the first interaction style, there are two approaches to move a cursor's position across the handheld display: move it towards the same direction or the opposite direction which the device moves to. In this paper, the results of a comparison research, which compared the pointing performances of three camera-based pointing techniques, are presented. All pointing techniques utilized input from the rear-facing camera. The results indicate that the interaction style of moving a finger before the camera outperforms the other one in efficiency, accuracy, and throughput. The results also indicate that within the interaction style of moving the device, the cursor positioning style of moving the cursor to the opposite direction is slightly better than the other one in efficiency and throughput. Based on the findings, we suggest giving priority to the interaction style of moving a finger when deploying camera-based pointing techniques on handheld devices. Given that the interaction style of moving the device supports one-handed manipulation, it also worth deploying when one-handed interaction is needed. According to the results, the cursor positioning style of moving the cursor towards the opposite direction which the device moves to may be a better choice.},
keywords={},
doi={10.1587/transele.2020DIP0003},
ISSN={1745-1353},
month={February},}

Copy

TY - JOUR
TI - A Comparison Study on Camera-Based Pointing Techniques for Handheld Displays
T2 - IEICE TRANSACTIONS on Electronics
SP - 73
EP - 80
AU - Liang CHEN
AU - Dongyi CHEN
PY - 2021
DO - 10.1587/transele.2020DIP0003
JO - IEICE TRANSACTIONS on Electronics
SN - 1745-1353
VL - E104-C
IS - 2
JA - IEICE TRANSACTIONS on Electronics
Y1 - February 2021
AB - Input devices based on direct touch have replaced traditional ones and become the mainstream interactive technology for handheld devices. Although direct touch interaction proves to be easy to use, its problems, e.g. the occlusion problem and the fat finger problem, lower user experience. Camera-based mobile interaction is one of the solutions to overcome the problems. There are two typical interaction styles to generate camera-based pointing interaction for handheld devices: move the device or move an object before the camera. In the first interaction style, there are two approaches to move a cursor's position across the handheld display: move it towards the same direction or the opposite direction which the device moves to. In this paper, the results of a comparison research, which compared the pointing performances of three camera-based pointing techniques, are presented. All pointing techniques utilized input from the rear-facing camera. The results indicate that the interaction style of moving a finger before the camera outperforms the other one in efficiency, accuracy, and throughput. The results also indicate that within the interaction style of moving the device, the cursor positioning style of moving the cursor to the opposite direction is slightly better than the other one in efficiency and throughput. Based on the findings, we suggest giving priority to the interaction style of moving a finger when deploying camera-based pointing techniques on handheld devices. Given that the interaction style of moving the device supports one-handed manipulation, it also worth deploying when one-handed interaction is needed. According to the results, the cursor positioning style of moving the cursor towards the opposite direction which the device moves to may be a better choice.
ER -

IEICE TRANSACTIONS on Electronics