Multi-Spectral Band Selection and Spatial Explanations Using XAI Algorithms in Remote Sensing Applications
Author
Abstract

This work proposes an interpretable Deep Learning framework utilizing Vision Transformers (ViT) for the classification of remote sensing images into land use and land cover (LULC) classes. It uses the Shapley Additive Explanations (SHAP) values to achieve two-stage explanations: 1) bandwise feature importance per class, showing which band assists the prediction of each class and 2) spatial-wise feature understanding, explaining which embedded patches per band affected the network’s performance. Experimental results on the EuroSAT dataset demonstrate the ViT’s accurate classification with an overall accuracy 96.86 \%, offering improved results when compared to popular CNN models. Heatmaps in each one of the dataset’s existing classes highlight the effectiveness of the proposed framework in the band explanation and the feature importance.

Year of Publication
2023
Date Published
jul
Publisher
IEEE
Conference Location
Pasadena, CA, USA
ISBN Number
9798350320107
URL
https://ieeexplore.ieee.org/document/10282565/
DOI
10.1109/IGARSS52108.2023.10282565
Google Scholar | BibTeX | DOI