HoloDx: Knowledge- and Data-Driven Multimodal Diagnosis of Alzheimer's Disease.

Abstract

Accurate diagnosis of Alzheimer's disease (AD) requires effectively integrating multimodal data and clinical expertise. However, existing methods often struggle to fully utilize multimodal information and lack structured mechanisms to incorporate dynamic domain knowledge. To address these limitations, we propose HoloDx, a knowledge- and data-driven framework that enhances AD diagnosis by aligning domain knowledge with multimodal clinical data. HoloDx incorporates a knowledge injection module with a knowledge-aware gated cross-attention, allowing the model to dynamically integrate domain-specific insights from both large language models (LLMs) and clinical expertise. A memory injection module with prototypical memory attention further enables consistency preservation across decision trajectories. Through synergistic operation of these components, HoloDx achieves enhanced interpretability while maintaining precise knowledge-data alignment. Evaluations on five AD datasets demonstrate that HoloDx outperforms state-of-the-art methods, achieving superior diagnostic accuracy and strong generalization across diverse cohorts. The source code is released at https://github.com/Qybc/HoloDx.