We propose a method to determine accurate motion fields and illumination conditions such as non-uniform or non-stationary illuminations. The method extends a stabilization method using reliability indices of optical flow to combine with a gradient-based approach that determines a motion field and illumination conditions simultaneously. We applied the proposed method to two synthetic image sequences and a standard image sequence. The method is effective for image sequences including poorly textured areas, edges of brightness variation, and almost dark objects.