In this paper, we propose a new neural filter to which the features related to a given task are input, called a neural filter with features (NFF), to improve further the performance of the conventional neural filter. In order to handle the issue concerning the optimal selection of input features, we propose a framework composed of 1) manual selection of candidates for input features related to a given task and 2) training with automatically selection of the optimal input features required for achieving the given task. Experiments on the proposed framework with an application to improving the image quality of medical X-ray image sequences were performed. The experimental results demonstrated that the performance on edge-preserving smoothing of the NFF, obtained by the proposed framework, is superior to that of the conventional neural and dynamic filters.