The Implementation of the RISE Algorithm for the Captum Framework

The Implementation of the RISE Algorithm for the Captum Framework


Conference paper
Black BoxComputer VisionDeep LearningInterpretabilityRISE
Authors: Oscar Stanchi, Franco Ronchetti, Facundo Quiroga

Abstract

This paper introduces an implementation of the RISE method, using the Captum library in PyTorch. RISE is an algorithm that generates explanations for the predictions of a deep learning model by randomly masking parts of the input image and observing the changes in the model’s output. Our focus is on the implementation and its performance, rather than on the RISE method itself. Through a series of experiments, we have obtained results that demonstrate the importance of the number of masks used in the RISE method. We found that the number of masks can have a significant impact on the interpretability of the outcome. Additionally, we conducted tests to determine the effect of mask size on the interpretability of the results. Our findings indicate that the size of the masks, whether larger or smaller, is also a decisive factor in achieving a good interpretable outcome. Furthermore, we demonstrate how tuning RISE parameters can yield in different results, making RISE effective for several tasks and neural network architectures. Overall, our implementation of RISE over Captum provides a powerful tool for interpreting deep learning models in PyTorch.

Citation

@inproceedings{stanchi2023implementation,
  title={The Implementation of the RISE Algorithm for the Captum Framework},
  author={Stanchi, Oscar and Ronchetti, Franco and Quiroga, Facundo},
  booktitle={Conference on Cloud Computing, Big Data \& Emerging Topics},
  pages={91--104},
  year={2023},
  organization={Springer}
}
© 2024 Oscar Stanchi