Movie Map for Virtual Exploration in a City

Kiyoharu AIZAWA

doi:10.1587/transinf.2021MUI0001

Movie Map for Virtual Exploration in a City

Kiyoharu AIZAWA

Full Text Views

0

Cite this

Summary :

This paper introduces our work on a Movie Map, which will enable users to explore a given city area using 360° videos. Visual exploration of a city is always needed. Nowadays, we are familiar with Google Street View (GSV) that is an interactive visual map. Despite the wide use of GSV, it provides sparse images of streets, which often confuses users and lowers user satisfaction. Forty years ago, a video-based interactive map was created - it is well-known as Aspen Movie Map. Movie Map uses videos instead of sparse images and seems to improve the user experience dramatically. However, Aspen Movie Map was based on analog technology with a huge effort and never built again. Thus, we renovate the Movie Map using state-of-the-art technology. We build a new Movie Map system with an interface for exploring cities. The system consists of four stages; acquisition, analysis, management, and interaction. After acquiring 360° videos along streets in target areas, the analysis of videos is almost automatic. Frames of the video are localized on the map, intersections are detected, and videos are segmented. Turning views at intersections are synthesized. By connecting the video segments following the specified movement in an area, we can watch a walking view along a street. The interface allows for easy exploration of a target area. It can also show virtual billboards in the view.

Publication: IEICE TRANSACTIONS on Information Vol.E105-D No.1 pp.38-45

Publication Date: 2022/01/01

Publicized: 2021/10/12

Online ISSN: 1745-1361

DOI: 10.1587/transinf.2021MUI0001

Type of Manuscript: Special Section INVITED PAPER (Special Section on Enriched Multimedia — Multimedia Technologies Enhancing User Experience —)

Category

Authors

Kiyoharu AIZAWA
Graduate School of Information Science and Technology of the University of Tokyo

Keyword

Movie Map, street view, image processing, interaction, visual SLAM

Cite this

Copy

Kiyoharu AIZAWA, "Movie Map for Virtual Exploration in a City" in IEICE TRANSACTIONS on Information, vol. E105-D, no. 1, pp. 38-45, January 2022, doi: 10.1587/transinf.2021MUI0001.
Abstract: This paper introduces our work on a Movie Map, which will enable users to explore a given city area using 360° videos. Visual exploration of a city is always needed. Nowadays, we are familiar with Google Street View (GSV) that is an interactive visual map. Despite the wide use of GSV, it provides sparse images of streets, which often confuses users and lowers user satisfaction. Forty years ago, a video-based interactive map was created - it is well-known as Aspen Movie Map. Movie Map uses videos instead of sparse images and seems to improve the user experience dramatically. However, Aspen Movie Map was based on analog technology with a huge effort and never built again. Thus, we renovate the Movie Map using state-of-the-art technology. We build a new Movie Map system with an interface for exploring cities. The system consists of four stages; acquisition, analysis, management, and interaction. After acquiring 360° videos along streets in target areas, the analysis of videos is almost automatic. Frames of the video are localized on the map, intersections are detected, and videos are segmented. Turning views at intersections are synthesized. By connecting the video segments following the specified movement in an area, we can watch a walking view along a street. The interface allows for easy exploration of a target area. It can also show virtual billboards in the view.
URL: https://global.ieice.org/en_transactions/information/10.1587/transinf.2021MUI0001/_p

Copy

@ARTICLE{e105-d_1_38,
author={Kiyoharu AIZAWA, },
journal={IEICE TRANSACTIONS on Information},
title={Movie Map for Virtual Exploration in a City},
year={2022},
volume={E105-D},
number={1},
pages={38-45},
abstract={This paper introduces our work on a Movie Map, which will enable users to explore a given city area using 360° videos. Visual exploration of a city is always needed. Nowadays, we are familiar with Google Street View (GSV) that is an interactive visual map. Despite the wide use of GSV, it provides sparse images of streets, which often confuses users and lowers user satisfaction. Forty years ago, a video-based interactive map was created - it is well-known as Aspen Movie Map. Movie Map uses videos instead of sparse images and seems to improve the user experience dramatically. However, Aspen Movie Map was based on analog technology with a huge effort and never built again. Thus, we renovate the Movie Map using state-of-the-art technology. We build a new Movie Map system with an interface for exploring cities. The system consists of four stages; acquisition, analysis, management, and interaction. After acquiring 360° videos along streets in target areas, the analysis of videos is almost automatic. Frames of the video are localized on the map, intersections are detected, and videos are segmented. Turning views at intersections are synthesized. By connecting the video segments following the specified movement in an area, we can watch a walking view along a street. The interface allows for easy exploration of a target area. It can also show virtual billboards in the view.},
keywords={},
doi={10.1587/transinf.2021MUI0001},
ISSN={1745-1361},
month={January},}

Copy

TY - JOUR
TI - Movie Map for Virtual Exploration in a City
T2 - IEICE TRANSACTIONS on Information
SP - 38
EP - 45
AU - Kiyoharu AIZAWA
PY - 2022
DO - 10.1587/transinf.2021MUI0001
JO - IEICE TRANSACTIONS on Information
SN - 1745-1361
VL - E105-D
IS - 1
JA - IEICE TRANSACTIONS on Information
Y1 - January 2022
AB - This paper introduces our work on a Movie Map, which will enable users to explore a given city area using 360° videos. Visual exploration of a city is always needed. Nowadays, we are familiar with Google Street View (GSV) that is an interactive visual map. Despite the wide use of GSV, it provides sparse images of streets, which often confuses users and lowers user satisfaction. Forty years ago, a video-based interactive map was created - it is well-known as Aspen Movie Map. Movie Map uses videos instead of sparse images and seems to improve the user experience dramatically. However, Aspen Movie Map was based on analog technology with a huge effort and never built again. Thus, we renovate the Movie Map using state-of-the-art technology. We build a new Movie Map system with an interface for exploring cities. The system consists of four stages; acquisition, analysis, management, and interaction. After acquiring 360° videos along streets in target areas, the analysis of videos is almost automatic. Frames of the video are localized on the map, intersections are detected, and videos are segmented. Turning views at intersections are synthesized. By connecting the video segments following the specified movement in an area, we can watch a walking view along a street. The interface allows for easy exploration of a target area. It can also show virtual billboards in the view.
ER -