A new motion analysis method and an image restoration process for removing motion blur are proposed. Motion analysis includes the motion estimation and motion-based segmentation. Based on the analysis, we can obtain an image divided into multiple segments with different point spread functions. For removing motion blur, we propose an image degradation model for the motion with an arbitrary direction and a regularized iterative restoration method. By using the proposed degradation model and the restoration method, we can efficiently remove the space-variant motion blur.