IEICE TRANSACTIONS on Information
Cognition-Aware Summarization of Photos Representing Events
Summary :
The use of photo summarization technology to summarize a photo collection is often oriented to users who own the photo collection. However, people's interest in sharing photos with others highlights the importance of cognition-aware summarization of photos by which viewers can easily recognize the exact event those photos represent. In this research, we address the problem of cognition-aware summarization of photos representing events, and propose to solve this problem and to improve the perceptual quality of a photo set by proactively preventing misrecognization that a photo set might bring. Three types of neighbor events that can possibly cause misrecognizations are discussed in this paper, namely sub-events, super-events and sibling-events. We analyze the reasons for these misrecognitions and then propose three criteria to prevent from them. A combination of the criteria is used to generate summarization of photos that can represent an event with several photos. Our approach was empirically demonstrated with photos from Flickr by utilizing their visual features and related tags. The results indicated the effectiveness of our proposed methods in comparison with a baseline method.
- Publication
- IEICE TRANSACTIONS on Information Vol.E99-D No.12 pp.3140-3153
- Publication Date
- 2016/12/01
- Publicized
- 2016/09/01
- Online ISSN
- 1745-1361
- DOI
- 10.1587/transinf.2016EDP7079
- Type of Manuscript
- PAPER
- Category
- Image Processing and Video Processing
Authors
Bei LIU
Kyoto University
Makoto P. KATO
Kyoto University
Katsumi TANAKA
Kyoto University
Keyword
Latest Issue
Copyrights notice of machine-translated contents
The copyright of the original papers published on this site belongs to IEICE. Unauthorized use of the original or translated papers is prohibited. See IEICE Provisions on Copyright for details.
Cite this
Copy
Bei LIU, Makoto P. KATO, Katsumi TANAKA, "Cognition-Aware Summarization of Photos Representing Events" in IEICE TRANSACTIONS on Information,
vol. E99-D, no. 12, pp. 3140-3153, December 2016, doi: 10.1587/transinf.2016EDP7079.
Abstract: The use of photo summarization technology to summarize a photo collection is often oriented to users who own the photo collection. However, people's interest in sharing photos with others highlights the importance of cognition-aware summarization of photos by which viewers can easily recognize the exact event those photos represent. In this research, we address the problem of cognition-aware summarization of photos representing events, and propose to solve this problem and to improve the perceptual quality of a photo set by proactively preventing misrecognization that a photo set might bring. Three types of neighbor events that can possibly cause misrecognizations are discussed in this paper, namely sub-events, super-events and sibling-events. We analyze the reasons for these misrecognitions and then propose three criteria to prevent from them. A combination of the criteria is used to generate summarization of photos that can represent an event with several photos. Our approach was empirically demonstrated with photos from Flickr by utilizing their visual features and related tags. The results indicated the effectiveness of our proposed methods in comparison with a baseline method.
URL: https://global.ieice.org/en_transactions/information/10.1587/transinf.2016EDP7079/_p
Copy
@ARTICLE{e99-d_12_3140,
author={Bei LIU, Makoto P. KATO, Katsumi TANAKA, },
journal={IEICE TRANSACTIONS on Information},
title={Cognition-Aware Summarization of Photos Representing Events},
year={2016},
volume={E99-D},
number={12},
pages={3140-3153},
abstract={The use of photo summarization technology to summarize a photo collection is often oriented to users who own the photo collection. However, people's interest in sharing photos with others highlights the importance of cognition-aware summarization of photos by which viewers can easily recognize the exact event those photos represent. In this research, we address the problem of cognition-aware summarization of photos representing events, and propose to solve this problem and to improve the perceptual quality of a photo set by proactively preventing misrecognization that a photo set might bring. Three types of neighbor events that can possibly cause misrecognizations are discussed in this paper, namely sub-events, super-events and sibling-events. We analyze the reasons for these misrecognitions and then propose three criteria to prevent from them. A combination of the criteria is used to generate summarization of photos that can represent an event with several photos. Our approach was empirically demonstrated with photos from Flickr by utilizing their visual features and related tags. The results indicated the effectiveness of our proposed methods in comparison with a baseline method.},
keywords={},
doi={10.1587/transinf.2016EDP7079},
ISSN={1745-1361},
month={December},}
Copy
TY - JOUR
TI - Cognition-Aware Summarization of Photos Representing Events
T2 - IEICE TRANSACTIONS on Information
SP - 3140
EP - 3153
AU - Bei LIU
AU - Makoto P. KATO
AU - Katsumi TANAKA
PY - 2016
DO - 10.1587/transinf.2016EDP7079
JO - IEICE TRANSACTIONS on Information
SN - 1745-1361
VL - E99-D
IS - 12
JA - IEICE TRANSACTIONS on Information
Y1 - December 2016
AB - The use of photo summarization technology to summarize a photo collection is often oriented to users who own the photo collection. However, people's interest in sharing photos with others highlights the importance of cognition-aware summarization of photos by which viewers can easily recognize the exact event those photos represent. In this research, we address the problem of cognition-aware summarization of photos representing events, and propose to solve this problem and to improve the perceptual quality of a photo set by proactively preventing misrecognization that a photo set might bring. Three types of neighbor events that can possibly cause misrecognizations are discussed in this paper, namely sub-events, super-events and sibling-events. We analyze the reasons for these misrecognitions and then propose three criteria to prevent from them. A combination of the criteria is used to generate summarization of photos that can represent an event with several photos. Our approach was empirically demonstrated with photos from Flickr by utilizing their visual features and related tags. The results indicated the effectiveness of our proposed methods in comparison with a baseline method.
ER -
English
