This paper proposes a fast, efficient detection algorithm of missing data (also referred to as blotches) based on Markov Random Field (MRF) models with less computational load and a lower false alarm rate than the existing MRF-based blotch detection algorithms. The proposed algorithm can reduce the computational load by applying fast block-matching motion estimation based on the diamond searching pattern and restricting the attention of the blotch detection process to only the candidate bloch areas. The problem of confusion of the blotches is frequently seen in the vicinity of a moving object due to poorly estimated motion vectors. To solve this problem, we incorporate a weighting function with respect to the pixels, which are accurately detected by our moving edge detector and inputed into the formulation. To solve the blotch detection problem formulated as a maximum a posteriori (MAP) problem, an iterated conditional modes (ICM) algorithm is used. The experimental results show that our proposed method results in fewer blotch detection errors than the conventional blotch detectors, and enables lower computational cost and the more efficient detecting performance when compared with existing MRF-based detectors.

Among ITS applications, it is very important to acquire detailed statistics of traffic flows. For that purpose, vision sensors have an advantage because of their rich information compared to such spot sensors such as loop detectors or supersonic wave sensors. However, for many years, vehicle tracking in traffic images has suffered from the problems of occlusion effect and illumination effect. In order to resolve occlusion problems, we have been proposing the Spatio-Temporal Markov Random Field model(S-T MRF) for segmentation of Spatio-Temporal images. This S-T MRF model optimizes the segmentation boundaries of occluded vehicles and their motion vectors simultaneously by referring to textures and segment labeling correlations along the temporal axis as well as the spatial axis. Consequently, S-T MRF has been proven to be successful for vehicle tracking even against severe occlusions found in low-angle traffic images with complicated motions, such at highway junctions. In addition, in this paper, we define a method for obtaining illumination-invariant images by estimating MRF energy among neighbor pixel intensities. These illumination-invariant images are very stable even when sudden variations in illumination or shading effect are occurred in the original images. We then succeeded in seamlessly integrating the method for MRF energy images into our S-T MRF model. Thus, vehicle tracking was performed successfully by S-T MRF, even against sudden variations in illumination and against shading effects . Finally, in order to verify the effectiveness of our tracking algorithm based on the S-T MRF for practical uses, we developed an automated system for acquiring traffic statistics out of a flow of traffic images. This system has been operating continuously for ten months, and thus effectiveness of the tracking algorithm based on S-T MRF model was proven.

A method of motion segmentation in RGB image sequences is presented in details. The method is based on moving object modeling by a six-variate Gaussian distribution and a hidden Markov random field (MRF) framework. It is an extended and improved version of our previous work. Based on mathematical principles the energy expression of MRF is modified. Moreover, an initialization procedure for the first frame of the sequence is introduced. Both modifications result in new interesting features. The first involves a rather simple parameter estimation which has to be performed before the use of the method. Now, the values of Maximum Likelihood (ML) estimators of the parameters can be used without any user's modifications. The last allows one to avoid finding manually the localization mask of moving object in the first frame. Experimental results showing the usefulness of the method are also included.

Parallel processing in speech recognition is described, which is carried out at each frame on time axis. We have already proposed a parallel processing algorithm for HMM (Hidden Markov Model)-based speech recognition using Markov Random Fields (MRF). The parallel processing is realized by modeling the hidden state sequence by an MRF and using the Iterated Conditional Modes (ICM) algorithm to estimate the optimal state sequence given an observation sequence and model parameters. However this parallel processing with the ICM algorithm is applicable only to the standard HMM but not to the improved HMM like the linear predictive HMM which takes into account the correlations between nearby observation vectors. In this paper we propose a parallel processing algorithm applicable to the correlation-considered HMM, where a new deterministic relaxation algorithm called the Generalized ICM (GICM) algorithm is used instead of the ICM algorithm for estimation of the optimal state sequence. Speaker independent isolated word recognition experiments show the effectiveness of the proposed parallel processing using the GICM algorithm.

An adaptive restoration algorithm is developed for binary images degraded nonadditively with flip noises. The true image is assumed to be a realization of a Markov Random Field (MRF) and the nonadditive flip noises are assumed to be statistically independent and asymmetric. Using the Expectation and Maximization (EM) method and approximating the Baum's auxiliary function, the degraded image is restored iteratively. The algorithm is implemented as follows. First, the unknown parameters and the true image are guessed or estimated roughly. Second, using the true image estimate, the Baum's auxiliary function is approximated and then the noise and MRF parameters are reestimated. To reestimate the MRF parameters the Maximum Pseudo-likelihood (MPL) method is used. Third, using the Iterated Conditional Modes (ICM) method, the true image is reestimated. The second and third steps are carried out iteratively until by some ad hoc criterion a critical point of EM algorithm is approximated. A number of simulation examples are presented which show the effectiveness of the algorithm and the parameter estimation procedures.