Federated Large Language Models for A Trustworthy and Privacy-Preserving Healthcare: Applications, Challenges, and Future Research Directions.

Abstract

Large-scale foundation models, especially Federated Large Language Models (FLLMs), aim to transform digital health by enabling clinically-grade natural language processing while keeping sensitive data local. However, their adoption is hindered by two main issues: (i) the computational and communication burden of parameter-rich models on resource-constrained Internet-of-Medical-Things (IoMT) devices, and (ii) performance degradation caused by Non-Independent and Identically Distributed (Non-IID) patient data. This paper presents a comprehensive survey of Federated Learning (FL) for LLMs in Healthcare (FedMed-LLMs). We review the foundations of FL and medical LLMs. Then, we present the FL-enabled LLMs applications in healthcare, and we examine their issues in terms of privacy, robustness, and trustworthiness. Finally, we present a set of core research problems and a comprehensive research agenda that identifies future directions for building robust and scalable FedMed-LLMs systems.