In order to provide a fuzzy system with learning function, numerous studies are being carried out to combine fuzzy systems and neural networks. The self-tuning methods using the descent method have been proposed. The constructive and the destructive methods are more powerful than other methods using neural networks (or descent method). On the other hand the destructive method is superior in the number of rules and inference error and inferior in learning speed to the constructive method. In this paper, we propose a new learning method combining the constructive and the destructive methods. The method is superior in the number of rules, inference error and learning speed to the destructive method. However, it is inferior in learning speed to the constructive method. Therefore, in order to improve learning speed of the proposed method, simplified learning methods are proposed. Some numerical examples are given to show the validity of the proposed methods.