Multi-Spectral Band Selection and Spatial Explanations Using XAI Algorithms in Remote Sensing Applications | |
---|---|
Author | |
Abstract |
This work proposes an interpretable Deep Learning framework utilizing Vision Transformers (ViT) for the classification of remote sensing images into land use and land cover (LULC) classes. It uses the Shapley Additive Explanations (SHAP) values to achieve two-stage explanations: 1) bandwise feature importance per class, showing which band assists the prediction of each class and 2) spatial-wise feature understanding, explaining which embedded patches per band affected the network’s performance. Experimental results on the EuroSAT dataset demonstrate the ViT’s accurate classification with an overall accuracy 96.86 \%, offering improved results when compared to popular CNN models. Heatmaps in each one of the dataset’s existing classes highlight the effectiveness of the proposed framework in the band explanation and the feature importance. |
Year of Publication |
2023
|
Date Published |
jul
|
Publisher |
IEEE
|
Conference Location |
Pasadena, CA, USA
|
ISBN Number |
9798350320107
|
URL |
https://ieeexplore.ieee.org/document/10282565/
|
DOI |
10.1109/IGARSS52108.2023.10282565
|
Google Scholar | BibTeX | DOI |