Context-enriched contrastive auto-encoder with topology learning for medical hyperspectral image classification to diagnose tumors.

Abstract

Deep learning has emerged as a highly effective approach for the automatic classification of medical hyperspectral images (MedHSIs), facilitating the accurate diagnosis of diverse tumors. Most of current methods suffer from the challenges in the separability of latent representation and the preservation of topological structure. To remedy such deficiencies, we propose a novel context-enriched contrastive auto-encoder with topology learning (CCAET) based MedHSI classification for tumor diagnosis. Concretely, we initially employ an auto-encoder (AE) network as the foundational framework to achieve latent representation and data reconstruction. Subsequently, to enhance the separability of the latent representation, we integrate a context-enriched contrastive loss into the AE framework, where both individual pixels and their contextual information are used to redefine contrastive learning, so that small distances between intra-class features and large distances between inter-class features are achieved. Further, we construct a topology-preserved loss by incorporating a graph based approach into the foundational framework, which aims to maintain the topological structure during latent representation learning. Furthermore, we devise a gradient descent-based optimization scheme to optimize the overall loss of the proposed CCAET method, so as to obtain the final latent representation of MedHSI. Finally, we implement soft-max-based label prediction to obtain the classification results. Different from most existing methods, the CCAET approach considers both the separability of latent representations and the preservation of topological structure to enhance MedHSI classification performance. Extensive experimental evidence has been presented to substantiate that the proposed CCAET method outperforms several state-of-the-art techniques in terms of MedHSI classification based tumor diagnosis.