The search functionality is under construction.
The search functionality is under construction.

Depth Image Noise Reduction and Super-Resolution by Pixel-Wise Multi-Frame Fusion

Masahiro MURAYAMA, Toyohiro HIGASHIYAMA, Yuki HARAZONO, Hirotake ISHII, Hiroshi SHIMODA, Shinobu OKIDO, Yasuyoshi TARUTA

  • Full Text Views

    0

  • Cite this

Summary :

High-quality depth images are required for stable and accurate computer vision. Depth images captured by depth cameras tend to be noisy, incomplete, and of low-resolution. Therefore, increasing the accuracy and resolution of depth images is desirable. We propose a method for reducing the noise and holes from depth images pixel by pixel, and increasing resolution. For each pixel in the target image, the linear space from the focal point of the camera through each pixel to the existing object is divided into equally spaced grids. In each grid, the difference from each grid to the object surface is obtained from multiple tracked depth images, which have noisy depth values of the respective image pixels. Then, the coordinates of the correct object surface are obtainable by reducing the depth random noise. The missing values are completed. The resolution can also be increased by creating new pixels between existing pixels and by then using the same process as that used for noise reduction. Evaluation results have demonstrated that the proposed method can do processing with less GPU memory. Furthermore, the proposed method was able to reduce noise more accurately, especially around edges, and was able to process more details of objects than the conventional method. The super-resolution of the proposed method also produced a high-resolution depth image with smoother and more accurate edges than the conventional methods.

Publication
IEICE TRANSACTIONS on Information Vol.E105-D No.6 pp.1211-1224
Publication Date
2022/06/01
Publicized
2022/03/04
Online ISSN
1745-1361
DOI
10.1587/transinf.2021EDP7226
Type of Manuscript
PAPER
Category
Image Processing and Video Processing

Authors

Masahiro MURAYAMA
  Kyoto University
Toyohiro HIGASHIYAMA
  Nomura Research Institute, Ltd.
Yuki HARAZONO
  Kyoto University
Hirotake ISHII
  Kyoto University
Hiroshi SHIMODA
  Kyoto University
Shinobu OKIDO
  Hitachi--GE Nuclear Energy, Ltd.
Yasuyoshi TARUTA
  Japan Atomic Energy Agency

Keyword