Cognition-Aware Summarization of Photos Representing Events

Bei LIU; Makoto P. KATO; Katsumi TANAKA

doi:10.1587/transinf.2016EDP7079

Cognition-Aware Summarization of Photos Representing Events

Bei LIU, Makoto P. KATO, Katsumi TANAKA

Full Text Views

0

Cite this

Summary :

The use of photo summarization technology to summarize a photo collection is often oriented to users who own the photo collection. However, people's interest in sharing photos with others highlights the importance of cognition-aware summarization of photos by which viewers can easily recognize the exact event those photos represent. In this research, we address the problem of cognition-aware summarization of photos representing events, and propose to solve this problem and to improve the perceptual quality of a photo set by proactively preventing misrecognization that a photo set might bring. Three types of neighbor events that can possibly cause misrecognizations are discussed in this paper, namely sub-events, super-events and sibling-events. We analyze the reasons for these misrecognitions and then propose three criteria to prevent from them. A combination of the criteria is used to generate summarization of photos that can represent an event with several photos. Our approach was empirically demonstrated with photos from Flickr by utilizing their visual features and related tags. The results indicated the effectiveness of our proposed methods in comparison with a baseline method.

Publication: IEICE TRANSACTIONS on Information Vol.E99-D No.12 pp.3140-3153

Publication Date: 2016/12/01

Publicized: 2016/09/01

Online ISSN: 1745-1361

DOI: 10.1587/transinf.2016EDP7079

Type of Manuscript: PAPER

Category: Image Processing and Video Processing

Authors

Bei LIU
  Kyoto University
Makoto P. KATO
  Kyoto University
Katsumi TANAKA
  Kyoto University

Keyword

cognition-aware, photo summarization, event

Cite this

Copy

Bei LIU, Makoto P. KATO, Katsumi TANAKA, "Cognition-Aware Summarization of Photos Representing Events" in IEICE TRANSACTIONS on Information, vol. E99-D, no. 12, pp. 3140-3153, December 2016, doi: 10.1587/transinf.2016EDP7079.
Abstract: The use of photo summarization technology to summarize a photo collection is often oriented to users who own the photo collection. However, people's interest in sharing photos with others highlights the importance of cognition-aware summarization of photos by which viewers can easily recognize the exact event those photos represent. In this research, we address the problem of cognition-aware summarization of photos representing events, and propose to solve this problem and to improve the perceptual quality of a photo set by proactively preventing misrecognization that a photo set might bring. Three types of neighbor events that can possibly cause misrecognizations are discussed in this paper, namely sub-events, super-events and sibling-events. We analyze the reasons for these misrecognitions and then propose three criteria to prevent from them. A combination of the criteria is used to generate summarization of photos that can represent an event with several photos. Our approach was empirically demonstrated with photos from Flickr by utilizing their visual features and related tags. The results indicated the effectiveness of our proposed methods in comparison with a baseline method.
URL: https://global.ieice.org/en_transactions/information/10.1587/transinf.2016EDP7079/_p

Copy

@ARTICLE{e99-d_12_3140,
author={Bei LIU, Makoto P. KATO, Katsumi TANAKA, },
journal={IEICE TRANSACTIONS on Information},
title={Cognition-Aware Summarization of Photos Representing Events},
year={2016},
volume={E99-D},
number={12},
pages={3140-3153},
abstract={The use of photo summarization technology to summarize a photo collection is often oriented to users who own the photo collection. However, people's interest in sharing photos with others highlights the importance of cognition-aware summarization of photos by which viewers can easily recognize the exact event those photos represent. In this research, we address the problem of cognition-aware summarization of photos representing events, and propose to solve this problem and to improve the perceptual quality of a photo set by proactively preventing misrecognization that a photo set might bring. Three types of neighbor events that can possibly cause misrecognizations are discussed in this paper, namely sub-events, super-events and sibling-events. We analyze the reasons for these misrecognitions and then propose three criteria to prevent from them. A combination of the criteria is used to generate summarization of photos that can represent an event with several photos. Our approach was empirically demonstrated with photos from Flickr by utilizing their visual features and related tags. The results indicated the effectiveness of our proposed methods in comparison with a baseline method.},
keywords={},
doi={10.1587/transinf.2016EDP7079},
ISSN={1745-1361},
month={December},}

Copy

TY - JOUR
TI - Cognition-Aware Summarization of Photos Representing Events
T2 - IEICE TRANSACTIONS on Information
SP - 3140
EP - 3153
AU - Bei LIU
AU - Makoto P. KATO
AU - Katsumi TANAKA
PY - 2016
DO - 10.1587/transinf.2016EDP7079
JO - IEICE TRANSACTIONS on Information
SN - 1745-1361
VL - E99-D
IS - 12
JA - IEICE TRANSACTIONS on Information
Y1 - December 2016
AB - The use of photo summarization technology to summarize a photo collection is often oriented to users who own the photo collection. However, people's interest in sharing photos with others highlights the importance of cognition-aware summarization of photos by which viewers can easily recognize the exact event those photos represent. In this research, we address the problem of cognition-aware summarization of photos representing events, and propose to solve this problem and to improve the perceptual quality of a photo set by proactively preventing misrecognization that a photo set might bring. Three types of neighbor events that can possibly cause misrecognizations are discussed in this paper, namely sub-events, super-events and sibling-events. We analyze the reasons for these misrecognitions and then propose three criteria to prevent from them. A combination of the criteria is used to generate summarization of photos that can represent an event with several photos. Our approach was empirically demonstrated with photos from Flickr by utilizing their visual features and related tags. The results indicated the effectiveness of our proposed methods in comparison with a baseline method.
ER -