High-quality depth images are required for stable and accurate computer vision. Depth images captured by depth cameras tend to be noisy, incomplete, and of low-resolution. Therefore, increasing the accuracy and resolution of depth images is desirable. We propose a method for reducing the noise and holes from depth images pixel by pixel, and increasing resolution. For each pixel in the target image, the linear space from the focal point of the camera through each pixel to the existing object is divided into equally spaced grids. In each grid, the difference from each grid to the object surface is obtained from multiple tracked depth images, which have noisy depth values of the respective image pixels. Then, the coordinates of the correct object surface are obtainable by reducing the depth random noise. The missing values are completed. The resolution can also be increased by creating new pixels between existing pixels and by then using the same process as that used for noise reduction. Evaluation results have demonstrated that the proposed method can do processing with less GPU memory. Furthermore, the proposed method was able to reduce noise more accurately, especially around edges, and was able to process more details of objects than the conventional method. The super-resolution of the proposed method also produced a high-resolution depth image with smoother and more accurate edges than the conventional methods.

Laser speech detection uses a non-contact Laser Doppler Vibrometry (LDV)-based acoustic sensor to obtain speech signals by precisely measuring voice-generated surface vibrations. Over long distances, however, the detected signal is very weak and full of speckle noise. To enhance the quality and intelligibility of the detected signal, we designed a two-sided Linear Prediction Coding (LPC)-based locator and interpolator to detect and replace speckle noise. We first studied the characteristics of speckle noise in detected signals and developed a binary-state statistical model for speckle noise generation. A two-sided LPC-based locator was then designed to locate the polluted samples, composed of an inverse decorrelator, nonlinear filter and threshold estimator. This greatly improves the detectability of speckle noise and avoids false/missed detection by improving the noise-to-signal-ratio (NSR). Finally, samples from both sides of the speckle noise were used to estimate the parameters of the interpolator and to code samples for replacing the polluted samples. Real-world speckle noise removal experiments and simulation-based comparative experiments were conducted and the results show that the proposed method is better able to locate speckle noise in laser detected speech and highly effective at replacing it.

For the impulse noise removal from a digital image, most of existing methods cannot repair line structures in an input image. In this letter, a method which considers the local line structure is proposed. In order to judge the direction of the line structure, adjacent lines are considered. The effectiveness of the proposed filter is shown by experiments.

This paper presents convex filter networks that are obtained from extensions of morphological filters. The proposed filter network consists of a convex and concave filter that are extensions of the dilation and erosion of mathematical morphology with the maxout activation function. Maxout can approximate arbitrary convex functions as piecewise linear functions, including the max function. The class of the convex function hence includes the morphological dilation and can be trained for specific image processing tasks. In this paper, the closing filter is extended to a convex-concave filter network with maxout. The convex-concave filter is trained by the stochastic gradient method for noise and mask removal. The examples of noise and mask removal show that the convex-concave filter can obtain a recovered image, whose quality is comparable to inpainting by using the total variation minimization with reduced computational cost without mask information of the corrupted pixels.

In this paper a new method for noise removal from single-trial event-related potentials recorded with a multi-channel electroencephalogram is addressed. An observed signal is separated into multiple signals with a multi-channel Wiener filter whose coefficients are estimated based on parameter estimation of a probabilistic generative model that locally models the amplitude of each separated signal in the time-frequency domain. Effectiveness of using prior information about covariance matrices to estimate model parameters and frequency dependent covariance matrices were shown through an experiment with a simulated event-related potential data set.

In the impulse noise removal from a color image, vector filters are suitable for suppressing false color generation. However, the vector filters do not select optimal vectors to restore noise corrupted pixels. To cope with this problem, a cost function-based vector filter is proposed in this letter.

In this paper, we propose a bitstream-level noise cancellation method for playback applications of damaged video. Most analog video data such as movies, news and historical research videos are now stored in a digital format after a series of conversion processes that include analog-to-digital conversion and compression. In many cases, noise such as blotches and line scratching remaining in analog media are not removed during the conversion process. On the other hand, noise is propagated in the compression stage because most media compression technologies use predictive coding. Therefore, it is imperative to efficiently remove or reduce the artifacts caused by noise as much as possible. In some cases, the video data with historical values are to be preserved without correcting the noise in order not to lose any important information resulting from the noise removal process. However, playback applications of such video data still need to undergo a noise reduction process to ensure picture quality for public viewing. The proposed algorithm identifies the candidate noise blocks at the bitstream-level to directly provide a noise reduction process while decoding the bitstream. Throughout the experimental results, we confirm the efficiency of the proposed method by showing RR and PR values of around 70 percent.

In this paper, impulse noise removal for digital images is handled. It is well-known that switching-type processing is effective for the impulse noise removal. In the process, noise-corrupted pixels are first detected, and then, filtering is applied to the detected pixels. This switching process prevents distorting original signals. A noise detector is of course important in the process, a filter for pixel value restoration is also important to obtain excellent results. The authors have proposed a local similarity-based filter (LSF). It utilizes local similarity in a digital image and its capability against restoration of orderly regions has shown in the previous paper. In this paper, first, further experiments are carried out and properties of the LSF are revealed. Although LSF is inferior to an existing filter when disorderly regions are processed and evaluated by the peak signal-to-noise ratio, its outputs are subjectively adequate even in the case. If noise positions are correctly detected, capability of the LSF is guaranteed. On the other hand, some errors may occur in actual noise detection. In that case, LSF sometimes fails to restoration. After properties are examined, we propose two effective extensions to the LSF. First one is for computational cost reduction and another is for color image processing. The original LSF is very time consuming, and in this paper, computational cost reduction is realized introducing a search area. Second proposal is the vector LSF (VLSF) for color images. Although color images can be processed using a filter, which is for monochrome images, to each color component, it sometimes causes color drift. Hence vector processing has been investigated so far. However, existing vector filters do not excel in preservation of orderly pattern although color drift is suppressed. Our proposed VLSF is superior both in orderly pattern preservation and color drift suppression. Effectiveness of the proposed extensions to LSF is verified through experiments.

Noise removal in engineering drawing is an important operation performed before other image analysis tasks. Many algorithms have been developed to remove salt-and-pepper noise from document images. Cleaning algorithms should remove noise while keeping the real part of the image unchanged. Some algorithms have disadvantages in cleaning operation that leads to removing of weak features such as short thin lines. Others leave the image with hairy noise attached to image objects. In this article a noise removal procedure called TrackAndMayDel (TAMD) is developed to enhance the noise removal of salt-and-pepper noise in binary images of engineering drawings. The procedure could be integrated with third party algorithms' logic to enhance their ability to remove noise by investigating the structure of pixels that are part of weak features. It can be integrated with other algorithms as a post-processing step to remove noise remaining in the image such as hairy noise attached with graphical elements. An algorithm is proposed by incorporating TAMD in a third party algorithm. Real scanned images from GREC'03 contest are used in the experiment. The images are corrupted by salt-and-pepper noise at 10%, 15%, and 20% levels. An objective performance measure that correlates with human vision as well as MSE and PSNR are used in this experiment. Performance evaluation of the introduced algorithm shows better-quality images compared to other algorithms.

In this paper, we present a directional interpolation filter in which the minimum and maximum pixels in the given window are excluded. Image pixels within a predefined window are ranked and classified as minimum-maximum or exclusive level, and then passed through the interpolation and identity filters, respectively. Extensive simulations show that the proposed filter performs better than other nonlinear filters in preserving desired image features while reducing impulse noise effectively.

In this paper, we propose a new method that can remove view-disturbing noises from stereo images. One of the thorny problems in outdoor surveillance by a camera is that adherent noises such as waterdrops on the protecting glass surface lens disturb the view from the camera. Therefore, we propose a method for removing adherent noises from stereo images taken with a stereo camera system. Our method is based on the stereo measurement and utilizes disparities between stereo image pair. Positions of noises in images can be detected by comparing disparities measured from stereo images with the distance between the stereo camera system and the glass surface. True disparities of image regions hidden by noises can be estimated from the property that disparities are generally similar with those around noises. Finally, we can remove noises from images by replacing the above regions with textures of corresponding image regions obtained by the disparity referring. Experimental results show the effectiveness of the proposed method.

Footsteps, with different shoes of heels, sneakers, leathers or even bare footed, will appear in different grounds of concrete, wood, etc. If a footstep is discriminable, the application to various fields can be considered. In this paper, the feature extraction of a footstep is investigated. We focus on the recognizing a certain kind of footstep waveforms under the restricted condition. We propose a new methodology using the feature parameter such as the peak frequency set by the mel-cepstrum analysis, the walking intervals and the similarity of spectrum envelope. It is shown for personal identification that the performance of the proposed method is effective.

A novel effective method for detection and removal impulse noise in highly corrupted color images is proposed. This detection-estimation method consists of two steps. Outliers are first detected using spatial relations between the color components. Then the detected noise pixels are replaced with the output of the vector median filter over a local spatially connected area excluding the outliers. Simulation results in a test color image show a superior performance of the proposed filtering algorithm comparing to the conventional vector median filter. The comparisons are made using a mean square error and a mean absolute error criteria.

In this paper, we present improved alternative sequential filter-edge detector using generalized directional morphological filters. Based on the properties of effective noise removal and detail preservation of the generalized directional morphological filters, we apply these filters to edge detection of noisy images. The performance of the edge detection in the presence of mixed noise is evaluated. Simulations show that edge detection method using generalized directional morphological filters can also improve the performance.

While high compression ratio has been achieved using recently developed image coding algorithm, the noise removal technique is considered as an important subject. This still holds for very low bitrate video coding, that is, MPEG-4 has defined it as a core experiment which is mainly concerned with block based discrete cosine transform (DCT) coding such as H.263 and MPEG-1. This paper describes a novel and practical technique which attempts to accomplish both noise suppression and detail preservation at the same time. Some of the conventional adaptive filters are designed to search a homogeneous region among the predetermined polygonal subregions, then to apply a smoothing operation within the selected subregion. It shall be, however noted that sometimes the predetermined subregion finally selected may still be hererogeneous. This fact leads us to a novel idea; instead of examining the predetermined regions, define a lot more flexible region likely to be homogeneous. In order to achieve this, we introduce the binary index. each pixel is classified into either the lower intensity group or higher intensity group based on a local statistics. Then a smoothing operation is applied within the pixels having the same group index as the pixel to be processed. Thus our scheme can search a homogeneous region appropriately. The adaptive smoothing adopted in the proposed scheme is also designed to be consistent with an important property of human visual system, i.e., the spatial masking. noise visibility decreases at spatial details such as edges and textures. Another advantage is that it can be realized with significantly low computations. The simulation results show that his approach can suppress the visible artifacts while retaining the fine details such as edge and texture.

It often occurs in the acoustic environment that a specific signal is contaminated by the additional noise of non-Gaussian distribution type. In order to extract exactly the various statistical information of only specific signal from the observed noisy data, a stochastic signal processing by use of digital computer is essential. In this study, a stochastic method for estimating the probability function of the specific signal embedded in the additional noise is first theoretically proposed in a suitable form for the quantized level observation. Then, the effectiveness of the proposed method is experimentally confirmed by applying it to the observed data in the acoustic environment.