The search functionality is under construction.
The search functionality is under construction.

Ensemble-Based Method for Correcting Global Explanation of Prediction Model

Masaki HAMAMOTO, Hiroyuki NAMBA, Masashi EGI

  • Full Text Views

    0

  • Cite this

Summary :

Explainable artificial intelligence (AI) technology enables us to quantitatively analyze the whole prediction logic of AI as a global explanation. However, unwanted relationships learned by AI due to data sparsity, high dimensionality, and noise are also visualized in the explanation, which deteriorates confidence in the AI. Thus, methods for correcting those unwanted relationships in explanation has been developed. However, since these methods are applicable only to differentiable machine learning (ML) models but not to non-differentiable models such as tree-based models, they are insufficient for covering a wide range of ML technology. Since these methods also require re-training of the model for correcting its explanation (i.e., in-processing method), they cannot be applied to black-box models provided by third parties. Therefore, we propose a method called ensemble-based explanation correction (EBEC) as a post-processing method for correcting the global explanation of a prediction model in a model-agnostic manner by using the Rashomon effect of statistics. We evaluated the performance of EBEC with three different tasks and analyzed its function in more detail. The evaluation results indicate that EBEC can correct global explanation of the model so that the explanation aligns with the domain knowledge given by the user while maintaining its accuracy. EBEC can be extended in various ways and combined with any method to improve correction performance since it is a post-processing-type correction method. Hence, EBEC would contribute to high-productivity ML modeling as a new type of explanation-correction method.

Publication
IEICE TRANSACTIONS on Information Vol.E106-D No.2 pp.218-228
Publication Date
2023/02/01
Publicized
2022/11/15
Online ISSN
1745-1361
DOI
10.1587/transinf.2022EDP7095
Type of Manuscript
PAPER
Category
Artificial Intelligence, Data Mining

Authors

Masaki HAMAMOTO
  Hitachi, Ltd.
Hiroyuki NAMBA
  Hitachi, Ltd.
Masashi EGI
  Hitachi, Ltd.

Keyword