PIC-XAI: Post-hoc Image Captioning Explanation using Segmentation
Author
Abstract

The rapid advancement in Deep Learning (DL) proposes viable solutions to various real-world problems. However, deploying DL-based models in some applications is hindered by their black-box nature and the inability to explain them. This has pushed Explainable Artificial Intelligence (XAI) research toward DL-based models, aiming to increase the trust by reducing their opacity. Although many XAI algorithms were proposed earlier, they lack the ability to explain certain tasks, i.e. image captioning (IC). This is caused by the IC task nature, e.g. the presence of multiple objects from the same category in the captioned image. In this paper we propose and investigate an XAI approach for this particular task. Additionally, we provide a method to evaluate XAI algorithms performance in the domain1.

Year of Publication
2023
Date Published
may
Publisher
IEEE
Conference Location
Timisoara, Romania
ISBN Number
9798350321104
URL
https://ieeexplore.ieee.org/document/10158563/
DOI
10.1109/SACI58269.2023.10158563
Google Scholar | BibTeX | DOI