We present a novel method to enable users to experience mobile interaction with digital content on external displays by embedding markers imperceptibly on the screen. Our method consists of two parts: marker embedding on external displays and marker detection. To embed markers, similar to previous work, we display complementary colors in alternating frames, which are selected by considering L*a*b color space in order to make the markers harder for humans to detect. Our marker detection process does not require mobile devices to be synchronized with the display, while certain constraints for the relation between camera and display update rate need to be fulfilled. In this paper, we have conducted three experiments. The results show 1) selecting complementary colors in the a*b* color plane maximizes imperceptibility, 2) our method is extremely robust when used with static contents and can handle animated contents up to certain optical flow levels, and 3) our method was proved to work well in case of small movements, but large movements can lead to loss of tracking.
Goshiro YAMAMOTO
Kyoto University Hospital
Luiz SAMPAIO
Nara Institute of Science and Technology
Takafumi TAKETOMI
Nara Institute of Science and Technology
Christian SANDOR
Nara Institute of Science and Technology
Hirokazu KATO
Nara Institute of Science and Technology
Tomohiro KURODA
Kyoto University Hospital
The copyright of the original papers published on this site belongs to IEICE. Unauthorized use of the original or translated papers is prohibited. See IEICE Provisions on Copyright for details.
Copy
Goshiro YAMAMOTO, Luiz SAMPAIO, Takafumi TAKETOMI, Christian SANDOR, Hirokazu KATO, Tomohiro KURODA, "Imperceptible On-Screen Markers for Mobile Interaction on Public Large Displays" in IEICE TRANSACTIONS on Information,
vol. E100-D, no. 9, pp. 2027-2036, September 2017, doi: 10.1587/transinf.2016PCP0015.
Abstract: We present a novel method to enable users to experience mobile interaction with digital content on external displays by embedding markers imperceptibly on the screen. Our method consists of two parts: marker embedding on external displays and marker detection. To embed markers, similar to previous work, we display complementary colors in alternating frames, which are selected by considering L*a*b color space in order to make the markers harder for humans to detect. Our marker detection process does not require mobile devices to be synchronized with the display, while certain constraints for the relation between camera and display update rate need to be fulfilled. In this paper, we have conducted three experiments. The results show 1) selecting complementary colors in the a*b* color plane maximizes imperceptibility, 2) our method is extremely robust when used with static contents and can handle animated contents up to certain optical flow levels, and 3) our method was proved to work well in case of small movements, but large movements can lead to loss of tracking.
URL: https://global.ieice.org/en_transactions/information/10.1587/transinf.2016PCP0015/_p
Copy
@ARTICLE{e100-d_9_2027,
author={Goshiro YAMAMOTO, Luiz SAMPAIO, Takafumi TAKETOMI, Christian SANDOR, Hirokazu KATO, Tomohiro KURODA, },
journal={IEICE TRANSACTIONS on Information},
title={Imperceptible On-Screen Markers for Mobile Interaction on Public Large Displays},
year={2017},
volume={E100-D},
number={9},
pages={2027-2036},
abstract={We present a novel method to enable users to experience mobile interaction with digital content on external displays by embedding markers imperceptibly on the screen. Our method consists of two parts: marker embedding on external displays and marker detection. To embed markers, similar to previous work, we display complementary colors in alternating frames, which are selected by considering L*a*b color space in order to make the markers harder for humans to detect. Our marker detection process does not require mobile devices to be synchronized with the display, while certain constraints for the relation between camera and display update rate need to be fulfilled. In this paper, we have conducted three experiments. The results show 1) selecting complementary colors in the a*b* color plane maximizes imperceptibility, 2) our method is extremely robust when used with static contents and can handle animated contents up to certain optical flow levels, and 3) our method was proved to work well in case of small movements, but large movements can lead to loss of tracking.},
keywords={},
doi={10.1587/transinf.2016PCP0015},
ISSN={1745-1361},
month={September},}
Copy
TY - JOUR
TI - Imperceptible On-Screen Markers for Mobile Interaction on Public Large Displays
T2 - IEICE TRANSACTIONS on Information
SP - 2027
EP - 2036
AU - Goshiro YAMAMOTO
AU - Luiz SAMPAIO
AU - Takafumi TAKETOMI
AU - Christian SANDOR
AU - Hirokazu KATO
AU - Tomohiro KURODA
PY - 2017
DO - 10.1587/transinf.2016PCP0015
JO - IEICE TRANSACTIONS on Information
SN - 1745-1361
VL - E100-D
IS - 9
JA - IEICE TRANSACTIONS on Information
Y1 - September 2017
AB - We present a novel method to enable users to experience mobile interaction with digital content on external displays by embedding markers imperceptibly on the screen. Our method consists of two parts: marker embedding on external displays and marker detection. To embed markers, similar to previous work, we display complementary colors in alternating frames, which are selected by considering L*a*b color space in order to make the markers harder for humans to detect. Our marker detection process does not require mobile devices to be synchronized with the display, while certain constraints for the relation between camera and display update rate need to be fulfilled. In this paper, we have conducted three experiments. The results show 1) selecting complementary colors in the a*b* color plane maximizes imperceptibility, 2) our method is extremely robust when used with static contents and can handle animated contents up to certain optical flow levels, and 3) our method was proved to work well in case of small movements, but large movements can lead to loss of tracking.
ER -