A Lightweight 3D Distillation Volumetric Transformer for 3D MRI Super-Resolution.

Abstract

Although existing 3D super-resolution methods for magnetic resonance imaging (MRI) volumetric data can provide better visual images than some traditional 2D methods, they should face challenge of increasing network's parameters and computing cost for getting higher reconstruction accuracy. To address this issue, a lightweight 3D multi scale distillation volumetric Transformer, named Transformer-based dual-attention feature distillation (TDAFD) network, is proposed for 3D MRI by utilizing 3D information hiding in images sufficiently. Our TDAFD network contains several proposed dual-attention feature distillation (DAFD) modules and two designed recursive volumetric Transformers (RVT). Concretely, the proposed DAFD module contains a multi-scale feature distillation (MSFD) block for extracting global features under different scales and a feature enhancement dual attention block (FEDAB) for concentrating on the key features better. In addition, our RVT develops 2D Transformer to 3D and save network's parameters via recursion operations for capturing long-term dependencies in volumetric images effectively. Therefore, our proposed TDAFD network can not only extract deeper features via multi scale feature distillation and Transformer, but also realize the balance of performances and network's parameters. Extensive experiments illustrate that our proposed method achieves superior reconstruction performances than some popular 3D MRI SR methods, and saves number of weights and FLOPs.