IEICE TRANSACTIONS on Information
Optimal Billboard Deformation via 3D Voxel for Free-Viewpoint System
Summary :
A free-viewpoint application has been developed that yields an immersive user experience. One of the simple free-viewpoint approaches called “billboard methods” is suitable for displaying a synthesized 3D view in a mobile device, but it suffers from the limitation that a billboard should be positioned in only one position in the world. This fact gives users an unacceptable impression in the case where an object being shot is situated at multiple points. To solve this problem, we propose optimal deformation of the billboard. The deformation is designed as a mapping of grid points in the input billboard silhouette to produce an optimal silhouette from an accurate voxel model of the object. We formulate and solve this procedure as a nonlinear optimization problem based on a grid-point constraint and some a priori information. Our results show that the proposed method generates a synthesized virtual image having a natural appearance and better objective score in terms of the silhouette and structural similarity.
- Publication
- IEICE TRANSACTIONS on Information Vol.E101-D No.9 pp.2381-2391
- Publication Date
- 2018/09/01
- Publicized
- 2018/06/18
- Online ISSN
- 1745-1361
- DOI
- 10.1587/transinf.2018EDP7039
- Type of Manuscript
- PAPER
- Category
- Image Processing and Video Processing
Authors
Keisuke NONAKA
KDDI Research, Inc.
Houari SABIRIN
KDDI Research, Inc.
Jun CHEN
KDDI Research, Inc.
Hiroshi SANKOH
KDDI Research, Inc.
Sei NAITO
KDDI Research, Inc.
Keyword
Latest Issue
Copyrights notice of machine-translated contents
The copyright of the original papers published on this site belongs to IEICE. Unauthorized use of the original or translated papers is prohibited. See IEICE Provisions on Copyright for details.
Cite this
Copy
Keisuke NONAKA, Houari SABIRIN, Jun CHEN, Hiroshi SANKOH, Sei NAITO, "Optimal Billboard Deformation via 3D Voxel for Free-Viewpoint System" in IEICE TRANSACTIONS on Information,
vol. E101-D, no. 9, pp. 2381-2391, September 2018, doi: 10.1587/transinf.2018EDP7039.
Abstract: A free-viewpoint application has been developed that yields an immersive user experience. One of the simple free-viewpoint approaches called “billboard methods” is suitable for displaying a synthesized 3D view in a mobile device, but it suffers from the limitation that a billboard should be positioned in only one position in the world. This fact gives users an unacceptable impression in the case where an object being shot is situated at multiple points. To solve this problem, we propose optimal deformation of the billboard. The deformation is designed as a mapping of grid points in the input billboard silhouette to produce an optimal silhouette from an accurate voxel model of the object. We formulate and solve this procedure as a nonlinear optimization problem based on a grid-point constraint and some a priori information. Our results show that the proposed method generates a synthesized virtual image having a natural appearance and better objective score in terms of the silhouette and structural similarity.
URL: https://global.ieice.org/en_transactions/information/10.1587/transinf.2018EDP7039/_p
Copy
@ARTICLE{e101-d_9_2381,
author={Keisuke NONAKA, Houari SABIRIN, Jun CHEN, Hiroshi SANKOH, Sei NAITO, },
journal={IEICE TRANSACTIONS on Information},
title={Optimal Billboard Deformation via 3D Voxel for Free-Viewpoint System},
year={2018},
volume={E101-D},
number={9},
pages={2381-2391},
abstract={A free-viewpoint application has been developed that yields an immersive user experience. One of the simple free-viewpoint approaches called “billboard methods” is suitable for displaying a synthesized 3D view in a mobile device, but it suffers from the limitation that a billboard should be positioned in only one position in the world. This fact gives users an unacceptable impression in the case where an object being shot is situated at multiple points. To solve this problem, we propose optimal deformation of the billboard. The deformation is designed as a mapping of grid points in the input billboard silhouette to produce an optimal silhouette from an accurate voxel model of the object. We formulate and solve this procedure as a nonlinear optimization problem based on a grid-point constraint and some a priori information. Our results show that the proposed method generates a synthesized virtual image having a natural appearance and better objective score in terms of the silhouette and structural similarity.},
keywords={},
doi={10.1587/transinf.2018EDP7039},
ISSN={1745-1361},
month={September},}
Copy
TY - JOUR
TI - Optimal Billboard Deformation via 3D Voxel for Free-Viewpoint System
T2 - IEICE TRANSACTIONS on Information
SP - 2381
EP - 2391
AU - Keisuke NONAKA
AU - Houari SABIRIN
AU - Jun CHEN
AU - Hiroshi SANKOH
AU - Sei NAITO
PY - 2018
DO - 10.1587/transinf.2018EDP7039
JO - IEICE TRANSACTIONS on Information
SN - 1745-1361
VL - E101-D
IS - 9
JA - IEICE TRANSACTIONS on Information
Y1 - September 2018
AB - A free-viewpoint application has been developed that yields an immersive user experience. One of the simple free-viewpoint approaches called “billboard methods” is suitable for displaying a synthesized 3D view in a mobile device, but it suffers from the limitation that a billboard should be positioned in only one position in the world. This fact gives users an unacceptable impression in the case where an object being shot is situated at multiple points. To solve this problem, we propose optimal deformation of the billboard. The deformation is designed as a mapping of grid points in the input billboard silhouette to produce an optimal silhouette from an accurate voxel model of the object. We formulate and solve this procedure as a nonlinear optimization problem based on a grid-point constraint and some a priori information. Our results show that the proposed method generates a synthesized virtual image having a natural appearance and better objective score in terms of the silhouette and structural similarity.
ER -
English
