Ubiquitous Home: Retrieval of Experiences in a Home Environment

Gamhewage C. DE SILVA; Toshihiko YAMASAKI; Kiyoharu AIZAWA

doi:10.1093/ietisy/e91-d.2.330

Ubiquitous Home: Retrieval of Experiences in a Home Environment

Gamhewage C. DE SILVA, Toshihiko YAMASAKI, Kiyoharu AIZAWA

Full Text Views

0

Cite this

Summary :

Automated capture and retrieval of experiences at home is interesting due to the wide variety and personal significance of such experiences. We present a system for retrieval and summarization of continuously captured multimedia data from Ubiquitous Home, a two-room house consisting of a large number of cameras and microphones. Data from pressure based sensors on the floor are analyzed to segment footsteps of different persons. Video and audio handover are implemented to retrieve continuous video streams corresponding to moving persons. An adaptive algorithm based on the rate of footsteps summarizes these video streams. A novel method for audio segmentation using multiple microphones is used for video retrieval based on sounds with high accuracy. An experiment, in which a family lived in this house for twelve days, was conducted. The system was evaluated by the residents who used the system for retrieving their own experiences; we report and discuss the results.

Publication: IEICE TRANSACTIONS on Information Vol.E91-D No.2 pp.330-340

Publication Date: 2008/02/01

Publicized

Online ISSN: 1745-1361

DOI: 10.1093/ietisy/e91-d.2.330

Type of Manuscript: PAPER

Category: Image Processing and Video Processing

Cite this

Copy

Gamhewage C. DE SILVA, Toshihiko YAMASAKI, Kiyoharu AIZAWA, "Ubiquitous Home: Retrieval of Experiences in a Home Environment" in IEICE TRANSACTIONS on Information, vol. E91-D, no. 2, pp. 330-340, February 2008, doi: 10.1093/ietisy/e91-d.2.330.
Abstract: Automated capture and retrieval of experiences at home is interesting due to the wide variety and personal significance of such experiences. We present a system for retrieval and summarization of continuously captured multimedia data from Ubiquitous Home, a two-room house consisting of a large number of cameras and microphones. Data from pressure based sensors on the floor are analyzed to segment footsteps of different persons. Video and audio handover are implemented to retrieve continuous video streams corresponding to moving persons. An adaptive algorithm based on the rate of footsteps summarizes these video streams. A novel method for audio segmentation using multiple microphones is used for video retrieval based on sounds with high accuracy. An experiment, in which a family lived in this house for twelve days, was conducted. The system was evaluated by the residents who used the system for retrieving their own experiences; we report and discuss the results.
URL: https://global.ieice.org/en_transactions/information/10.1093/ietisy/e91-d.2.330/_p

Copy

@ARTICLE{e91-d_2_330,
author={Gamhewage C. DE SILVA, Toshihiko YAMASAKI, Kiyoharu AIZAWA, },
journal={IEICE TRANSACTIONS on Information},
title={Ubiquitous Home: Retrieval of Experiences in a Home Environment},
year={2008},
volume={E91-D},
number={2},
pages={330-340},
abstract={Automated capture and retrieval of experiences at home is interesting due to the wide variety and personal significance of such experiences. We present a system for retrieval and summarization of continuously captured multimedia data from Ubiquitous Home, a two-room house consisting of a large number of cameras and microphones. Data from pressure based sensors on the floor are analyzed to segment footsteps of different persons. Video and audio handover are implemented to retrieve continuous video streams corresponding to moving persons. An adaptive algorithm based on the rate of footsteps summarizes these video streams. A novel method for audio segmentation using multiple microphones is used for video retrieval based on sounds with high accuracy. An experiment, in which a family lived in this house for twelve days, was conducted. The system was evaluated by the residents who used the system for retrieving their own experiences; we report and discuss the results.},
keywords={},
doi={10.1093/ietisy/e91-d.2.330},
ISSN={1745-1361},
month={February},}

Copy

TY - JOUR
TI - Ubiquitous Home: Retrieval of Experiences in a Home Environment
T2 - IEICE TRANSACTIONS on Information
SP - 330
EP - 340
AU - Gamhewage C. DE SILVA
AU - Toshihiko YAMASAKI
AU - Kiyoharu AIZAWA
PY - 2008
DO - 10.1093/ietisy/e91-d.2.330
JO - IEICE TRANSACTIONS on Information
SN - 1745-1361
VL - E91-D
IS - 2
JA - IEICE TRANSACTIONS on Information
Y1 - February 2008
AB - Automated capture and retrieval of experiences at home is interesting due to the wide variety and personal significance of such experiences. We present a system for retrieval and summarization of continuously captured multimedia data from Ubiquitous Home, a two-room house consisting of a large number of cameras and microphones. Data from pressure based sensors on the floor are analyzed to segment footsteps of different persons. Video and audio handover are implemented to retrieve continuous video streams corresponding to moving persons. An adaptive algorithm based on the rate of footsteps summarizes these video streams. A novel method for audio segmentation using multiple microphones is used for video retrieval based on sounds with high accuracy. An experiment, in which a family lived in this house for twelve days, was conducted. The system was evaluated by the residents who used the system for retrieving their own experiences; we report and discuss the results.
ER -