BSAN: A Self-Adapted Motor Imagery Decoding Framework Based on Contextual Information.

Abstract

In motor imagery (MI) decoding, it still remains challenging to excavate enough contextual information of MI in different brain regions and to bridge the cross-session variance in feature distributions. In light of these issues, our study presents an innovative Bi-Stream Adaptation Network (BSAN) to bolster network efficacy, aiming to improve MI-based brain-computer interface (BCI) robustness across sessions. Our framework consists of the Bi-attention module, feature extractor, classifier, and Bi-discriminator. Precisely, we devise the Bi-attention module to reveal granular context information of MI with performing multi-scale convolutions asymptotically. Then, after features extraction, Bi-discriminator is involved to align the features from different MI sessions such that a uniform and accurate representation of neural patterns is achieved. By such a workflow, the proposed BSAN allows for the effective fusion of context coherence and session-invariance within the network architecture, therefore diminishing the reliance of redundant MI trials for MI-BCI re-calibration. To empirically substantiate BSAN, comprehensive experiments are conducted based on two public MI datasets. With average accuracies of 78.97% and 83.79% on two public datasets, and an inference time of 2.99 ms on CPU-only devices, it is believed that our approach has the potential to accelerate the practical deployment of MI-BCI.